-- Logs begin at Tue 2021-12-14 02:32:15 UTC, end at Tue 2021-12-14 03:38:23 UTC. -- Dec 14 03:01:29.689290 dv-cinder-818037-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 14 03:01:29.697915 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 03:01:29 2021] *** Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: nodename: dv-cinder-818037-8-iscsi Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: machine: x86_64 Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: clock source: unix Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: pcre jit disabled Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: detected number of CPU cores: 4 Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: current working directory: / Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: detected binary path: /usr/bin/uwsgi-core Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: your processes number limit is 47680 Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: your memory page size is 4096 bytes Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: detected max file descriptor number: 2048 Dec 14 03:01:29.701674 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: lock engine: pthread robust mutexes Dec 14 03:01:29.702384 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: thunder lock: enabled Dec 14 03:01:29.702384 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 14 03:01:29.702384 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 03:01:29.746489 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: Python main interpreter initialized at 0x559eee8419c0 Dec 14 03:01:29.746489 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: python threads support enabled Dec 14 03:01:29.746489 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: your server socket listen backlog is limited to 100 connections Dec 14 03:01:29.746489 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: your mercy for graceful operations on workers is 90 seconds Dec 14 03:01:29.746822 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 03:01:29.746920 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: *** Operational MODE: preforking *** Dec 14 03:01:29.747214 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: *** uWSGI is running in multiple interpreter mode *** Dec 14 03:01:29.747214 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: spawned uWSGI master process (pid: 79264) Dec 14 03:01:29.747408 dv-cinder-818037-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 14 03:01:29.748754 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: spawned uWSGI worker 1 (pid: 79277, cores: 1) Dec 14 03:01:29.748754 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: spawned uWSGI worker 2 (pid: 79278, cores: 1) Dec 14 03:01:29.748754 dv-cinder-818037-8-iscsi devstack@keystone.service[79264]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 03:01:35.027012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:01:35.027012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: from cryptography.utils import int_from_bytes Dec 14 03:01:35.027775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:01:35.027775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: from cryptography.utils import int_from_bytes Dec 14 03:01:35.028178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:01:35.028178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: from cryptography.utils import int_from_bytes Dec 14 03:01:35.028292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:01:35.028292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: from cryptography.utils import int_from_bytes Dec 14 03:01:35.077316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:01:35.077477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:01:35.077560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:01:35.077650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:01:35.077727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] command line args: [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:01:35.077800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] command line args: [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:01:35.077936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:01:35.078019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:01:35.078098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ================================================================================ {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:01:35.078172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ================================================================================ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:01:35.078351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] admin_token = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.078434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] admin_token = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.078596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config_dir = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.078677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] config_dir = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.078782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.078863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.078962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config_source = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] config_source = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] debug = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] debug = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.079958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_config_append = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.080923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_config_append = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_dir = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_dir = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_file = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.081919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.082884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.083975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084781 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.084896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] publish_errors = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] publish_errors = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.085983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.086973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] standard_threads = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] standard_threads = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.087944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_journal = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] use_journal = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_json = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] use_json = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_stderr = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] use_stderr = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_syslog = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] use_syslog = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.088884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.089005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:01:35.089124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.089926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090806 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.090924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.091888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.092942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.093991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.094941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.095914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.096934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.097980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.098915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.099889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100777 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.100875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.101941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.102897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.103945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.104901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.105931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.106985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.107954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.108898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.109967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.110903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.external = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.external = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.111989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.112106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.112226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.112341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.112454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.password = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.112817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.password = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.112940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.token = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] auth.token = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.113976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.114949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.115918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.116968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.117082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.117198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.117313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.117438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.118086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.118271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.118461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.118636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.118807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.118990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.119231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.119397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.119532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.119647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.119762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.119886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.120934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.121990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.122990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.123949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.124890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.125941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.126886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.127995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.128929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.129994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.130931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.131903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.132950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.133064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.133218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.133863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.133982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.134911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135789 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.135915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.136972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.137897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138365 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.138946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.139898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.140957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.141996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.142938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.143895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.144951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.145951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] role.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] role.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.146888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.147966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.148921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.149977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.150918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151671 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.151905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.152967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.153896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.154935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.155891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.156929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.157974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.158898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.connection = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.159997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.160924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.161888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.162928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.163057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.163186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.163293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.163407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:01:35.163522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:01:35.163637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:01:35.190535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.190704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.190790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.190938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.191021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.191197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.199894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.199988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.229939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.230073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.230205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.230299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.282940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.283289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.332211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.332440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.332658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.332892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.399430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.399656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.399835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.399938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.400936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.423922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.424986 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.425064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.425198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.425285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.425412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.436779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.437009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.449644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.449844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.450999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.451164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 14 03:01:35.467936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.468145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 14 03:01:35.468454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.468536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.468672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 14 03:01:35.468754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 14 03:01:35.468919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.468997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.469166 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 14 03:01:35.469253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.469420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.469499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.469674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.469753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.469924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.470607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.480722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.480997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.481263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.481472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.481566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.481746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.482013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.482289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.489845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.490644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.493620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.493897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.494177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.494427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.494505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.494705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.494786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.494955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.495850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.496035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.496122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.496296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.496373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.496557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.496824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.497087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.522121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.523153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.523727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.524522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.525255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.525533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.529742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.530744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.531611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.531899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.532662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.532988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.539009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.539313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.540667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.540946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.544230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.544514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.544793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.545073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.545324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.545405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.545596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.545674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.545860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.545946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.546124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.546202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.546391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.546658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.546919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.547212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.564516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.564789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.565378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.565652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.569264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.570071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.572894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.573288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.573919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.574317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.578213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.579198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.581775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.582667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.585421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.585716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.585993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.586267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.586836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.587074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.587172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.587359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.587440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.587640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.587913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.588196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.607500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.607780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.608068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.608299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.608913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.609197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.609464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.609726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.616303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.617856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.618026 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.618299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.619565 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.619839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.621416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.621693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.621968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.622251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.622532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.622926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.623228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.623504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.623796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.624082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.635664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.635943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.636220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.636495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.636869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.637140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.637217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.637414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.637494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.637729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.638007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.638381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.638656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.638932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.655557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.658448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.658726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.660280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.661971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.663530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.663697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.665774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.665868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.666101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.666376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.667398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.667672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.667945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.673809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.675073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.675405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.676651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.678519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.678804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.679216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.679512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.679816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.680136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.680670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.680952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.688423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.688711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.688988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.689886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.690172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.690448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.696702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.696981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.697255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.697521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.697796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.698151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 14 03:01:35.698231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.698428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.698509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.698699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.698778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.698966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.699926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.700067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.700199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.700321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.700466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.700732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.700996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.701264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.701545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.701802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 14 03:01:35.738473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559eee8419c0 pid: 79278 (default app) Dec 14 03:01:35.739906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559eee8419c0 pid: 79277 (default app) Dec 14 03:01:35.741904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cd043-d168-4d72-8b7f-1f44f5fc3a88 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:35.742196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cd043-d168-4d72-8b7f-1f44f5fc3a88 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:35.742468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cd043-d168-4d72-8b7f-1f44f5fc3a88 None None] PATH_INFO: `/v3` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:35.746704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Dec 14 03:01:35 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:43.500453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18b6a4-c768-48c6-a985-a634dcbb77dd None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:43.500966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18b6a4-c768-48c6-a985-a634dcbb77dd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:43.501073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18b6a4-c768-48c6-a985-a634dcbb77dd None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:43.506026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:43 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:43.512557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:43.512943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:43.513095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:43.543878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG oslo_db.sqlalchemy.engines [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:01:43.731465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG passlib.handlers.bcrypt [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79278) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 14 03:01:43.731924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG passlib.handlers.bcrypt [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79278) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 14 03:01:43.787064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:43.788581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:43.915254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:01:44.062926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18b6a4-c768-48c6-a985-a634dcbb77dd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:44.096895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG oslo_db.sqlalchemy.engines [None req-1c18b6a4-c768-48c6-a985-a634dcbb77dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:01:44.223518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18b6a4-c768-48c6-a985-a634dcbb77dd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:44.228306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:44.228953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:44.229234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:44.229507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:44.237343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:44.291666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.common.rbac_enforcer.enforcer [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 14 03:01:44.292004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273145e0-436c-411f-b82e-fa41bf0657dd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:44.302919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:01:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:01:44.309960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:44.323878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ba1fb-ef77-4be5-9d43-f3ca557c1128 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:44.328139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:44.329231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:44.329508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:44.329773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] PATH_INFO: `/v3/projects/f5a40efb96444e869a317e4d0c361d64` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:44.331278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] RBAC: Authorizing `identity:get_project(project_id=f5a40efb96444e869a317e4d0c361d64)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:44.383856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 14 03:01:44.384196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a7d7e-5f05-40ec-b45f-1f2116810801 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:44.388762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:01:44 2021] GET /identity/v3/projects/f5a40efb96444e869a317e4d0c361d64 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:46.670121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418a8a-2d5e-4eed-a568-c5b3beac781f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:46.670534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418a8a-2d5e-4eed-a568-c5b3beac781f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:46.670677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418a8a-2d5e-4eed-a568-c5b3beac781f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:46.675230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:01:46.681251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:46.681700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:46.682404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:46.700541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:46.702039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:46.709689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:46.732419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418a8a-2d5e-4eed-a568-c5b3beac781f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:46.745050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418a8a-2d5e-4eed-a568-c5b3beac781f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:46.749194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ebbfc-60fb-4851-a077-da92dea3464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:46.749805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ebbfc-60fb-4851-a077-da92dea3464e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:46.750086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ebbfc-60fb-4851-a077-da92dea3464e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:46.750360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ebbfc-60fb-4851-a077-da92dea3464e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:46.757861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ebbfc-60fb-4851-a077-da92dea3464e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:46.759649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ebbfc-60fb-4851-a077-da92dea3464e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:46.768104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:01:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:01:46.774143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:46.782751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ec544-1a3e-4f96-9d42-695a62593ff2 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:46.787084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1302-0b93-4096-9989-427959525c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:46.787917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1302-0b93-4096-9989-427959525c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:46.788196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1302-0b93-4096-9989-427959525c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:46.788467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1302-0b93-4096-9989-427959525c27 admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:46.790432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1302-0b93-4096-9989-427959525c27 admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:46.792294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1302-0b93-4096-9989-427959525c27 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:46.793817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:01:46 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:49.180118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d2ff-3ce2-4869-b608-1562e6b9d691 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.180674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d2ff-3ce2-4869-b608-1562e6b9d691 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.180674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d2ff-3ce2-4869-b608-1562e6b9d691 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.182505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:49.188385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.188761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.188942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.193855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6df3-d70e-4aac-ad61-e194f1573e90 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.194146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6df3-d70e-4aac-ad61-e194f1573e90 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.194425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6df3-d70e-4aac-ad61-e194f1573e90 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.196704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:01:49.202229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558366-d951-4a61-aaaf-8c812121008f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.202519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558366-d951-4a61-aaaf-8c812121008f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.202797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558366-d951-4a61-aaaf-8c812121008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.206818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:49.208022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:49.215470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:49.238864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.244499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG passlib.handlers.bcrypt [None req-af558366-d951-4a61-aaaf-8c812121008f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79277) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 14 03:01:49.244940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG passlib.handlers.bcrypt [None req-af558366-d951-4a61-aaaf-8c812121008f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79277) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 14 03:01:49.248144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d46b2-64db-4761-ba23-1e8aa5fc25a8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.252470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.253241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.253523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.253799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.266876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:01:49.273686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:01:49.274847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 7/13] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:01:49.280517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.289495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9dd5-5a92-409e-837b-be55d4ca7e9f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.290900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-af558366-d951-4a61-aaaf-8c812121008f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:49.292524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-af558366-d951-4a61-aaaf-8c812121008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:49.293703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.294282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.294564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.294836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.295593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:01:49.295896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:49.297635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:49.297635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:01:49.297635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:01:49.298516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:49.312462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 8/14] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:01:49.315366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:01:49.318110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.327794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09ca5-a3d0-4bc9-b259-c602ff96b9de admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.332055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.332870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.333151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.333423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.334621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:49.336464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:49.338428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:49.338536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558366-d951-4a61-aaaf-8c812121008f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.343806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.347895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558366-d951-4a61-aaaf-8c812121008f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.352225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.352809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e822961-140e-4580-a545-c27234b30c80 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.353167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.353454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.353734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.357058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.357771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.358056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.358331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.359491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:49.361130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:49.361634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:49.363014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 10/17] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:01:49.363779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:49.369164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.372895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 8/18] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:01:49.378286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea000e-bc62-4722-be2e-de0fd587b46f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.378479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:49.382524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.383706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.383984 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.384254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.385066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.domain.id=default, user.id=a56319b0d4c140e5b834fcb4b4fa313b) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:01:49.385371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:49.386331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:49.386331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:01:49.386331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:01:49.387490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa6e9b-2b52-4148-8b12-076d2818dfb3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:49.387650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7cb0-a96a-4937-a9b8-17b20b4c120c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:49.392011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ed296-a0c2-4292-b3af-87021a0255b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:49.392751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ed296-a0c2-4292-b3af-87021a0255b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:49.393029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ed296-a0c2-4292-b3af-87021a0255b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:49.393301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ed296-a0c2-4292-b3af-87021a0255b9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:49.394005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 11/19] 10.222.0.43 () {56 vars in 1343 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/role_assignments?user.id=a56319b0d4c140e5b834fcb4b4fa313b&scope.domain.id=default&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 233 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:01:49.394660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ed296-a0c2-4292-b3af-87021a0255b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:49.396365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ed296-a0c2-4292-b3af-87021a0255b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:49.397955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 9/20] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:01:52.089450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e9a00-48b4-4c8c-9822-316e90ab784f None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.090472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e9a00-48b4-4c8c-9822-316e90ab784f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.090967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e9a00-48b4-4c8c-9822-316e90ab784f None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.093455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 12/21] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:52.105619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.106582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.107085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.136238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:52.137804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:52.146540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 10/22] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:52.170364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e9a00-48b4-4c8c-9822-316e90ab784f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.185088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e9a00-48b4-4c8c-9822-316e90ab784f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.191861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.192925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.193410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.193898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.327751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:01:52.335006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:01:52.342352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 13/23] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:01:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:01:52.343968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.353992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d5492-820d-4a24-8a8c-8ab3e4d2de57 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.362965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.363906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.364387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.364878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.365840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:01:52.366344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:52.368339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:52.368339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:01:52.368339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:01:52.369564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:52.392783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 11/24] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:01:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:52.399739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.409900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2684e9-79b6-4efc-879b-eff9b6070cbd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.414673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.415813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.416299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.416771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.418219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:52.420314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:52.426916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 14/25] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:01:52 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:52.428571 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.438954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896d90-aaaf-44ec-8891-697e28aff77a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.443952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb2bc9-e746-4997-909d-4eb5b03be373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.444981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb2bc9-e746-4997-909d-4eb5b03be373 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.445998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb2bc9-e746-4997-909d-4eb5b03be373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.446466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb2bc9-e746-4997-909d-4eb5b03be373 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.447929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb2bc9-e746-4997-909d-4eb5b03be373 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:52.449859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb2bc9-e746-4997-909d-4eb5b03be373 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:52.456724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 12/26] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:52.458217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.469058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5b56-1118-4ecb-a8f0-e1eae79e8cb3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.478594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.479783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.480266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.480740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] PATH_INFO: `/v3/domains/default/users/a56319b0d4c140e5b834fcb4b4fa313b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.483063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a56319b0d4c140e5b834fcb4b4fa313b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:52.484376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:52.484376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:01:52.484376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:01:52.486736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35764ec-92f3-4937-bca2-15f22a4d3d35 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:52.583601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eb207-27c5-41ed-9685-e020f5a38b12 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.584252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eb207-27c5-41ed-9685-e020f5a38b12 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.584742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eb207-27c5-41ed-9685-e020f5a38b12 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.587503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:52.593622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.594153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.594616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.628050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:52.629550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:52.647147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1382 bytes} [Tue Dec 14 03:01:52 2021] PUT /identity/v3/domains/default/users/a56319b0d4c140e5b834fcb4b4fa313b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:01:52.660481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc95525-4da8-41f8-99f1-cdb90a58deb6 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.661042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc95525-4da8-41f8-99f1-cdb90a58deb6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.661512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc95525-4da8-41f8-99f1-cdb90a58deb6 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.667174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 16/29] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:52 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:01:52.680691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.681120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.681506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.715877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:52.717458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:52.809429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 14/30] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:52.835286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 17/31] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:01:52.848328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.866334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55586f07-83b2-48e1-8f2d-64d46897190a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.877059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.877647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:52.877759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.878030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.878299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.879120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:52.880167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:52.880167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:01:52.880167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:01:52.881090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:52.888160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e730-4a96-46e1-a9bc-164ebfa0ef6b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:52.903168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:52.903916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:52.904201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:52.904480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:52.905337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:52.906800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:52.906800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:01:52.906800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:01:52.915302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c605441-c666-4429-bf25-98c06c9ac64e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:52.952641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 18/32] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:01:52 2021] POST /identity/v3/roles => generated 225 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:01:53.113061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e8e0-f65e-4f70-99b6-19451c1cffed None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.113777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e8e0-f65e-4f70-99b6-19451c1cffed None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.113777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e8e0-f65e-4f70-99b6-19451c1cffed None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.115718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 19/33] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:53.122326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.122639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.122883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.134913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 15/34] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:01:52 2021] POST /identity/v3/roles => generated 219 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:01:53.160395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:53.161677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:53.182182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 20/35] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:53.223003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:53.234437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d00c69-9f93-477a-88b2-19670efd5147 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:53.247156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:53.247975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.248258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.248537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.260929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:53.262986 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:53.290042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:01:53.291713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 16/36] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:01:53.298282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:53.314952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e35a5-b29f-4a06-bf12-3dabf1713b6c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:53.323423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:53.324108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.324394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.324672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.325429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:01:53.325742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:53.326799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:53.326799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:01:53.326799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:01:53.327747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83b00-72d0-46ab-8db7-10a960f94700 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:53.355440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 21/37] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:01:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:53.361899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:53.373251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e8a0-052e-4503-826c-fefa800fbe8b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:53.383626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:53.384301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.384584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.384859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.385621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:53.386765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:53.386765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:01:53.386765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:01:53.388037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616d0b5-a4c1-4ca5-96ea-d3a553e44fab admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:53.444960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 17/38] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:01:53 2021] POST /identity/v3/projects => generated 301 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:01:53.682778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59eef0-0c4a-4080-9a7e-337e1e9bee75 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.683166 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59eef0-0c4a-4080-9a7e-337e1e9bee75 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.683380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59eef0-0c4a-4080-9a7e-337e1e9bee75 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.685240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 22/39] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:53.691922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0675c6-653d-4249-a691-d8b7f487da62 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.692221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0675c6-653d-4249-a691-d8b7f487da62 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.692489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0675c6-653d-4249-a691-d8b7f487da62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.716826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5d0675c6-653d-4249-a691-d8b7f487da62 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:53.718439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5d0675c6-653d-4249-a691-d8b7f487da62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:53.783347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 18/40] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:53.807255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59eef0-0c4a-4080-9a7e-337e1e9bee75 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:53.819747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59eef0-0c4a-4080-9a7e-337e1e9bee75 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:53.825029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c69e-8ddb-4b66-a11c-c8e9cff75ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:53.825679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c69e-8ddb-4b66-a11c-c8e9cff75ffa admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:53.825963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c69e-8ddb-4b66-a11c-c8e9cff75ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:53.826237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c69e-8ddb-4b66-a11c-c8e9cff75ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:53.827007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534c69e-8ddb-4b66-a11c-c8e9cff75ffa admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:53.828671 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534c69e-8ddb-4b66-a11c-c8e9cff75ffa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:53.844403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 23/41] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:01:53 2021] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:01:54.083105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058bc6f-0e33-46cd-b10e-865015b37347 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:54.083459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058bc6f-0e33-46cd-b10e-865015b37347 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:54.083686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058bc6f-0e33-46cd-b10e-865015b37347 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:54.085504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 19/42] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:54.091495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:54.091788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:54.092075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:54.110265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:54.111489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:54.119807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 24/43] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:54.143740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058bc6f-0e33-46cd-b10e-865015b37347 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:54.156505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058bc6f-0e33-46cd-b10e-865015b37347 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:54.160768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954762-643f-43c3-a91d-ff9e16603931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:54.161553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954762-643f-43c3-a91d-ff9e16603931 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:54.161840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954762-643f-43c3-a91d-ff9e16603931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:54.162119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954762-643f-43c3-a91d-ff9e16603931 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:54.163342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954762-643f-43c3-a91d-ff9e16603931 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:54.165612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954762-643f-43c3-a91d-ff9e16603931 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:54.167245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 20/44] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:54.173163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:54.182842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aad9e-470b-4f46-9650-b2d5fd44d9e1 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:54.187310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:54.187951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:54.188238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:54.188521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:54.189252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:54.190280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:54.190280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:01:54.190280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:01:54.191513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae0e2a-f128-466d-b6c0-c2d11c1c3e45 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:54.218080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 25/45] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:01:54 2021] POST /identity/v3/projects => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:01:55.347711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3c526-c16c-4d00-a7ea-4600be8202c4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.348248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3c526-c16c-4d00-a7ea-4600be8202c4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.348248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3c526-c16c-4d00-a7ea-4600be8202c4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.350084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 21/46] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:55.356987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.357487 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.357690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.376590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:55.377781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:55.433086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 26/47] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:55.456970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3c526-c16c-4d00-a7ea-4600be8202c4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:55.469392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3c526-c16c-4d00-a7ea-4600be8202c4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:55.473617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:55.474390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.474675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.474953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.485923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:01:55.492959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:01:55.494128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 22/48] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:01:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:01:55.500382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:55.509843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1685a-fb3c-41d2-a9e1-6bdffddbf595 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:55.514262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:55.514914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.515231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.515512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.516277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:01:55.516587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:55.518212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:55.526819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 27/49] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:01:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:55.532538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:55.542597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6799-0cc9-4cbe-8590-a088b2fc8a94 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:55.546963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:55.547842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.548130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.548409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.549869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:55.551741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:55.553315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 23/50] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:01:55 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:01:55.559121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:55.568590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b372b-f868-4d5c-83ec-cec79e31cf7e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:55.573489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b6a91-c9e7-48ae-95e7-bb24c4ec18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:55.574263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b6a91-c9e7-48ae-95e7-bb24c4ec18e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.574705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b6a91-c9e7-48ae-95e7-bb24c4ec18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.574982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b6a91-c9e7-48ae-95e7-bb24c4ec18e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.576205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b6a91-c9e7-48ae-95e7-bb24c4ec18e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:55.577913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b6a91-c9e7-48ae-95e7-bb24c4ec18e0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:55.579500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 28/51] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:55.585341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:55.595453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71db2f-3ccc-4854-8eff-7f581f495ffc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:55.599930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:55.600509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:55.600793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:55.601072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:55.601939 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.domain.id=default, user.id=a56319b0d4c140e5b834fcb4b4fa313b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:01:55.602255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:55.603290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:55.603290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:01:55.603290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:01:55.604452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49443-5930-4cad-917e-a23095f1e1b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:55.611416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 24/52] 10.222.0.43 () {56 vars in 1343 bytes} [Tue Dec 14 03:01:55 2021] GET /identity/v3/role_assignments?user.id=a56319b0d4c140e5b834fcb4b4fa313b&scope.domain.id=default&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:01:56.553680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353e463-9998-43ea-9cd7-601ca2b5fa7a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:56.554191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353e463-9998-43ea-9cd7-601ca2b5fa7a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:56.554272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353e463-9998-43ea-9cd7-601ca2b5fa7a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:56.556067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 29/53] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:56.561629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:56.562035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:56.562186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:56.579408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:56.580566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:56.588810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 25/54] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:56.612530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353e463-9998-43ea-9cd7-601ca2b5fa7a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:56.624550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353e463-9998-43ea-9cd7-601ca2b5fa7a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:56.628798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f0cb-d648-4963-8068-7b23d1c12999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:56.629563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f0cb-d648-4963-8068-7b23d1c12999 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:56.629847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f0cb-d648-4963-8068-7b23d1c12999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:56.630128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f0cb-d648-4963-8068-7b23d1c12999 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:56.631316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2f0cb-d648-4963-8068-7b23d1c12999 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:56.633004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2f0cb-d648-4963-8068-7b23d1c12999 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:56.634555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:56.645374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:56.654662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0eabb-5fc7-4ce9-85c1-2bd35053abcb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:56.659116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075defe-e5f7-48e1-be47-22c345a4b1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:56.659760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075defe-e5f7-48e1-be47-22c345a4b1cb admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:56.660041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075defe-e5f7-48e1-be47-22c345a4b1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:56.660313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075defe-e5f7-48e1-be47-22c345a4b1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:56.661036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075defe-e5f7-48e1-be47-22c345a4b1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:56.662949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075defe-e5f7-48e1-be47-22c345a4b1cb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:56.687016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 26/56] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Dec 14 03:01:56 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:01:58.994580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e896e-bb9c-414d-8f19-89d6ed583dd1 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:58.995081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e896e-bb9c-414d-8f19-89d6ed583dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:58.995081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e896e-bb9c-414d-8f19-89d6ed583dd1 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:58.996856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 31/57] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:01:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:01:59.002523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:59.002909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:59.003106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:59.021122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:01:59.022308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:01:59.075701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 27/58] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:01:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:01:59.099844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e896e-bb9c-414d-8f19-89d6ed583dd1 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:59.111635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e896e-bb9c-414d-8f19-89d6ed583dd1 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:59.116159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950d2ae-2d8e-457b-8d65-2b1343e42e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:59.117408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d2ae-2d8e-457b-8d65-2b1343e42e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:59.117694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d2ae-2d8e-457b-8d65-2b1343e42e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:59.117974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d2ae-2d8e-457b-8d65-2b1343e42e62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:59.119196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d2ae-2d8e-457b-8d65-2b1343e42e62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:59.120904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d2ae-2d8e-457b-8d65-2b1343e42e62 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:59.122462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 32/59] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:01:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:01:59.127757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:01:59.136713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859ea4c-b973-4b36-9fd1-fb5dea8e839d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:01:59.141123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:01:59.141758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:01:59.142037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:01:59.142311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:01:59.143034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:01:59.144071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:01:59.144071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:01:59.144071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:01:59.145275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326b37-ab37-4cdf-9e7b-069866949036 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:01:59.169736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 28/60] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:01:59 2021] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:02.563879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e576-ffad-4dce-ac52-29c2f69169b9 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.564892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e576-ffad-4dce-ac52-29c2f69169b9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.565384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e576-ffad-4dce-ac52-29c2f69169b9 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.567654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 33/61] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:02.573251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.574036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.574504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.596980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:02.598473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:02.612475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 29/62] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:02.660518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e576-ffad-4dce-ac52-29c2f69169b9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.679854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e576-ffad-4dce-ac52-29c2f69169b9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.684873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65065c-7d31-4793-887f-a529600828e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.685895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65065c-7d31-4793-887f-a529600828e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.686368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65065c-7d31-4793-887f-a529600828e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.686828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65065c-7d31-4793-887f-a529600828e0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.703940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65065c-7d31-4793-887f-a529600828e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:02.711589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-9a65065c-7d31-4793-887f-a529600828e0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:02.713025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 34/63] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:02.719315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.729583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6c876-7a82-4e1d-bed4-1bfbc86eeef8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.736382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2b52-06df-4054-9d78-c8a9b8eb0f87 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.737003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2b52-06df-4054-9d78-c8a9b8eb0f87 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.738326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2b52-06df-4054-9d78-c8a9b8eb0f87 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.740441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 35/64] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:02.742144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.742839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.743166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.743448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.744250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:02.744563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.746259 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.754740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.755470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.755941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.764488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 30/65] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:02.771660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.779876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:02.781070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:02.788301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee2830-7263-400b-ae55-cfc35500e918 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.796254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 36/66] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:02.805271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.806147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.806431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.806762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.820930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.831086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79a4e2-8cf6-4f03-b9ef-acc76231a774 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.836728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.838905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.840648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 31/67] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:02.843237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.844213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.844501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.844777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.850978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.863528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:02.870878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:02.872277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 37/68] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:02.878209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.879615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44e39-ffa9-4199-9846-a30fe70fa3be admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.888507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ee689-16b2-440c-866d-5c20d9e32e95 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.893015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.893142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.893648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.893754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.893921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.894016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.894199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.894293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.895001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:02.895334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.896959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.906503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 38/69] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:02.913052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.916186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.917988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.924372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55143-d5a8-42bd-9e3a-3b4799daf474 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.930436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.931534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.931818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.932096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.933452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.935583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.937495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 39/70] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:02.938554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 32/71] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:02.943196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.945187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:02.959510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0b5bf-d4b8-4047-9428-058cc2c4df05 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.963273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1689f2-205b-4baa-998a-90b2f5806ce0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:02.964548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.965425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.965919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.966394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.980970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:02.982096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:02.982602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:02.983121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:02.984735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.985639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:02.989112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.990248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:02.992727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 33/72] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:02.999357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.007077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 40/73] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:03.009748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44135a-cea1-4499-8b66-47ce87f9f106 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.014804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.015759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.016240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.016708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.017832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=c4579f2065e048128e4718c2a0eff280) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:03.018361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.018460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.020544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.027024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 34/74] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:02 2021] GET /identity/v3/role_assignments?user.id=c4579f2065e048128e4718c2a0eff280&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=087c457f13d74023b2c0f38de56ab52c => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.037805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e348-b6dc-408d-a0b1-56f215b8d801 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.052744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115b60a-7740-4ae3-ab4b-556e4e54a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.053622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b60a-7740-4ae3-ab4b-556e4e54a9af admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.053901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b60a-7740-4ae3-ab4b-556e4e54a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.054745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b60a-7740-4ae3-ab4b-556e4e54a9af admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.060104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115b60a-7740-4ae3-ab4b-556e4e54a9af admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.062239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115b60a-7740-4ae3-ab4b-556e4e54a9af admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.064133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 41/75] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:03.070687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.085187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224cfc0-c730-4ceb-9143-e575e84a11af admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.099933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.101536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.102026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.102501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.103597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=a56319b0d4c140e5b834fcb4b4fa313b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:03.104144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.106290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e38e2-4dbc-4e3e-a08e-e22f9a675197 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.113347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 35/76] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/role_assignments?user.id=a56319b0d4c140e5b834fcb4b4fa313b&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.154289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674b7d-4f10-48ab-8e96-641604f5746d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.154606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674b7d-4f10-48ab-8e96-641604f5746d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.154849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674b7d-4f10-48ab-8e96-641604f5746d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.156787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 42/77] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:03.163360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d0a0e-b144-4dd4-9d00-92b0e10b1ba8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.164528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d0a0e-b144-4dd4-9d00-92b0e10b1ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.165005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d0a0e-b144-4dd4-9d00-92b0e10b1ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.192401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4a5d0a0e-b144-4dd4-9d00-92b0e10b1ba8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:03.194112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4a5d0a0e-b144-4dd4-9d00-92b0e10b1ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:03.208563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 36/78] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:03.244211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674b7d-4f10-48ab-8e96-641604f5746d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.265824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674b7d-4f10-48ab-8e96-641604f5746d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.276146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.276985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.277270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.277553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.278478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4d5e-77dc-42dc-9ad3-c9f67704e3db None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.279105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4d5e-77dc-42dc-9ad3-c9f67704e3db None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.279584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4d5e-77dc-42dc-9ad3-c9f67704e3db None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.281765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 37/79] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:03.290041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.290664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.291577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.303155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:03.322385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:03.324373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 43/80] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:03.327720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:03.328905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:03.332292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.345022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a884f4-031e-4a52-9278-c5374d58e28f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.345673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 38/81] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:03.358964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.359930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.360357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.360775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.361679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:03.362125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.367210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.375909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.376734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 44/82] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.382672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.385826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e89fd-bb0b-4f08-9b6c-130100683b8e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.393707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103068-a8f4-4a7d-95f4-d6d3fa73d2f5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.396491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa98d3-1080-49cc-9e47-3e9043a0a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.397279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa98d3-1080-49cc-9e47-3e9043a0a2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.397561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa98d3-1080-49cc-9e47-3e9043a0a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.398369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa98d3-1080-49cc-9e47-3e9043a0a2c8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.400015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa98d3-1080-49cc-9e47-3e9043a0a2c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.402320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa98d3-1080-49cc-9e47-3e9043a0a2c8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.403174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.404034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.404312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.404601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.405729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 39/83] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.405830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.410817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.410817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 45/84] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.416117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.417085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b015a7-d54c-49cb-8e9a-cd1f4b47ef57 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.417628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b015a7-d54c-49cb-8e9a-cd1f4b47ef57 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.418101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b015a7-d54c-49cb-8e9a-cd1f4b47ef57 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.420251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 40/85] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:03.421452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b015a7-d54c-49cb-8e9a-cd1f4b47ef57 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.426278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d098-2614-41be-9992-9eb47ddf62a4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.430986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.431721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.432415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.432415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.433044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.434118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:03.434118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:02:03.434118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:02:03.435405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2a5c9-8f87-497c-996a-f9892b0297ad admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.437856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b015a7-d54c-49cb-8e9a-cd1f4b47ef57 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.442496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.443377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.443861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.444332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.454804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.457371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.466574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 46/86] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:03 2021] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:03.468099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.468516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.469030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.476850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 41/87] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:03.484966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.500907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:03.501857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1848-ceb4-405a-8788-eb81cfbd661e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.502540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:03.507509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.508502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.508890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.509330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.510968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.511834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 47/88] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:03.513747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.517154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 42/89] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:03.533744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.536387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.550939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6dc6e-f7e1-4d06-8475-f8ea9ad7cc28 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.553806 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f930390-b3f4-44ba-a286-445221ccb130 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.562195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.562497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.564306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.565001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.565419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.565841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.566308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.566762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.567799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] RBAC: Adding query filter params (role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=c4579f2065e048128e4718c2a0eff280) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:03.568968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.573313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.587335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 48/90] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/role_assignments?user.id=c4579f2065e048128e4718c2a0eff280&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=a6a04d23aca344bc927a9b392991e951 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.590985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:03.598954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:03.600637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 43/91] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:03.608062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.620876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648d1b1-8831-43f2-8a47-07a5386e5581 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.627849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.628919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.629349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.629756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.630731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:03.631206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.633751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.651570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 49/92] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.659328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.672853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054292-ac81-4708-b790-ea4cffce7931 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.684414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.685591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.686013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.686447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.688670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.691287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.693362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 44/93] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.700316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.713092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20964c10-c018-446a-a2c1-3ee6eb8e28eb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.720592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.721556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.721981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.722442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.736424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.738853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.749137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 50/94] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:03.755386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.766718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192f5b-85ba-4a6c-af94-804debf719c5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.772655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd72e9-bf20-4d17-8be7-ea67e45a55d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.774419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd72e9-bf20-4d17-8be7-ea67e45a55d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.774893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd72e9-bf20-4d17-8be7-ea67e45a55d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.775413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd72e9-bf20-4d17-8be7-ea67e45a55d1 admin admin] PATH_INFO: `/v3/projects/34e54ecd03fe4378b9390d621a55b8b4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.776908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd72e9-bf20-4d17-8be7-ea67e45a55d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=34e54ecd03fe4378b9390d621a55b8b4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.779392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd72e9-bf20-4d17-8be7-ea67e45a55d1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.781378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 45/95] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/projects/34e54ecd03fe4378b9390d621a55b8b4 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:03.788073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:03.797794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5bdb-2f8e-4e50-aa62-6f354b3c884b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:03.803643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:03.804742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:03.805221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:03.805720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:03.806788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=34e54ecd03fe4378b9390d621a55b8b4, user.id=c4579f2065e048128e4718c2a0eff280) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:03.807381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:03.809554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6aa28-bb1c-4689-9cda-3ea43a5365ad admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:03.816233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 51/96] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:03 2021] GET /identity/v3/role_assignments?user.id=c4579f2065e048128e4718c2a0eff280&scope.project.id=34e54ecd03fe4378b9390d621a55b8b4&role.id=087c457f13d74023b2c0f38de56ab52c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:06.089901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8468a-4052-4911-aba4-0e4c743601cc None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.090952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8468a-4052-4911-aba4-0e4c743601cc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.091480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8468a-4052-4911-aba4-0e4c743601cc None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.093478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 46/97] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:06.099642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.100499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.101553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.128383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:06.129874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:06.137771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 52/98] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:06.185032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8468a-4052-4911-aba4-0e4c743601cc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.200767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8468a-4052-4911-aba4-0e4c743601cc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.210637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.211451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.211737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.212015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.227898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:06.234778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:06.236021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 47/99] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:06.243061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.256033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efab0d-6e2d-4961-920b-48a4b514a901 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.267075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.268008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.268490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.268952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.269909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:06.270421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.272287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.291314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 53/100] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.297855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.312756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691104-d266-412e-9633-7210d80cac3c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.323149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.324040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.324331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.324611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.325856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.328049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.329838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 48/101] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.336278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.352828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c6489-e4a8-4f6b-98b2-77818c091ae6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.363377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c82a20-2a03-4851-9e14-92228aaee572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.364517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c82a20-2a03-4851-9e14-92228aaee572 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.365002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c82a20-2a03-4851-9e14-92228aaee572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.365473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c82a20-2a03-4851-9e14-92228aaee572 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.371839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c82a20-2a03-4851-9e14-92228aaee572 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.374210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c82a20-2a03-4851-9e14-92228aaee572 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.376149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 54/102] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.382340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.396504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3299-f788-4fcf-9818-e631d8407811 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.406682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.407597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.407885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.408165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/c4579f2065e048128e4718c2a0eff280/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.410174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f09e72d52d44edad5f503d25ed1815, user_id=c4579f2065e048128e4718c2a0eff280, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.411240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:06.411240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:06.411240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:06.413184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f3a48-bdae-4aaf-9fbd-29256fdcc74d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.438149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 49/103] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:06 2021] PUT /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/c4579f2065e048128e4718c2a0eff280/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:06.580984 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231e963-f925-4c32-9017-3dcb9b903f7f None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.581623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231e963-f925-4c32-9017-3dcb9b903f7f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.582122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231e963-f925-4c32-9017-3dcb9b903f7f None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.584181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 55/104] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:06.591156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc28f-d43e-4c1c-a8c5-5c4488fd39a3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.591459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc28f-d43e-4c1c-a8c5-5c4488fd39a3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.591726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc28f-d43e-4c1c-a8c5-5c4488fd39a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.615697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a86cc28f-d43e-4c1c-a8c5-5c4488fd39a3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:06.616899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a86cc28f-d43e-4c1c-a8c5-5c4488fd39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:06.709934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 50/105] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:06.728837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b44a80-d49b-405c-b34a-92d685e77906 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.729486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b44a80-d49b-405c-b34a-92d685e77906 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.730016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b44a80-d49b-405c-b34a-92d685e77906 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.732087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 56/106] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:06.738843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d21e-4848-49ab-9f0b-a93a069f1f9a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.739164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d21e-4848-49ab-9f0b-a93a069f1f9a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.739444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d21e-4848-49ab-9f0b-a93a069f1f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.763871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b44a80-d49b-405c-b34a-92d685e77906 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.768841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d3a3d21e-4848-49ab-9f0b-a93a069f1f9a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:06.770310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d3a3d21e-4848-49ab-9f0b-a93a069f1f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:06.781014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 51/107] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:06.788975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b44a80-d49b-405c-b34a-92d685e77906 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.796270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.797458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.798012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.798512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.811843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de32c48-4b3a-43ce-9c2b-9339a13d3bf4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.812154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de32c48-4b3a-43ce-9c2b-9339a13d3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.812412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de32c48-4b3a-43ce-9c2b-9339a13d3bf4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.814451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 52/108] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:06.817348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:06.821543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.821832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.822112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.825171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:06.826810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 57/109] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:06.831314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.843872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec31451-8f14-4afd-b472-da44aab765cf admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.849153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.849288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:06.849943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.850227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.850504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.850602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:06.860955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 53/110] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:06.861839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.862502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:06.870400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:06.873802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 58/111] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:06.885900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b88545-e736-4608-ab4f-1da1f17753d9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.887677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.890559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.891269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.891553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.891951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.892759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:06.893069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.894851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.905110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 54/112] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.907998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1faaf5-4704-492c-924d-778a2a9e8247 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.911731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.913646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.914339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.914622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.914895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.915706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:06.916013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.917698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.922601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd1378-7b26-44e8-b4c7-3a8c015f7f93 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.928413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 59/113] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.929553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.934779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.935705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.935991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.936270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.937601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.939509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.940473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebde22-5a4a-4075-aab5-d3c9992fe16b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.941174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 55/114] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:06.942085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.945879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.946732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.947020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.947404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.957060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ded58-71bd-45b6-9aa6-3a250d3a1995 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.961339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:06.962280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.963285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.963565 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.963902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.965227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.967540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.968809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:06.969537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 56/115] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.970210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 60/116] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:06.970383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.976554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.985352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ce701-ce54-4671-91d4-d1f49047636a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.987541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65554-bef3-44a6-811a-b81a7e455fb5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:06.990195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.991030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.991350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.992154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.993367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.993558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:06.994377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:06.994661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:06.994934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] PATH_INFO: `/v3/projects/34e54ecd03fe4378b9390d621a55b8b4` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:06.995450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:06.996220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] RBAC: Authorizing `identity:get_project(project_id=34e54ecd03fe4378b9390d621a55b8b4)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:06.997121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 57/117] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:06.997872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:06.998922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.000775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 61/118] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/projects/34e54ecd03fe4378b9390d621a55b8b4 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.004031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.015703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd185f9-951f-45c5-aae1-b17d77d92a9d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.017369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b169-c235-403d-9e65-9c0c692d6d39 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.021189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.021879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.022214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.022497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.022764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.022903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/a56319b0d4c140e5b834fcb4b4fa313b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.023207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.023552 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.024382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:07.024759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.025080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f09e72d52d44edad5f503d25ed1815, user_id=a56319b0d4c140e5b834fcb4b4fa313b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.026501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.028137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.035530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 58/119] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.036348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.049069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 62/120] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:07 2021] PUT /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/a56319b0d4c140e5b834fcb4b4fa313b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:07.049904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.050714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfdbc4-79f0-49b3-94f4-72641b9525dd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.177266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.178178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.178467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.178742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] PATH_INFO: `/v3/projects/34e54ecd03fe4378b9390d621a55b8b4/users/c4579f2065e048128e4718c2a0eff280/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.182677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e54ecd03fe4378b9390d621a55b8b4, user_id=c4579f2065e048128e4718c2a0eff280, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.185882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4b08-275b-432a-9cd0-a9ee2d4936bf admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.188511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.198046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.199067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.199489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.199796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.201515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.203951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.210688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 63/121] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.217853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 59/122] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:07 2021] PUT /identity/v3/projects/34e54ecd03fe4378b9390d621a55b8b4/users/c4579f2065e048128e4718c2a0eff280/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:07.219807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.230640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f54a25-c3b1-4cef-92db-fa518073b963 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.294349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5157-6fee-4abd-af33-89eba3fc6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.295249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5157-6fee-4abd-af33-89eba3fc6bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.295538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5157-6fee-4abd-af33-89eba3fc6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.295815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5157-6fee-4abd-af33-89eba3fc6bfa admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.297052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb5157-6fee-4abd-af33-89eba3fc6bfa admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.299317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb5157-6fee-4abd-af33-89eba3fc6bfa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.301200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 64/123] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.308399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.322688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824fc77-cd50-406b-9dc6-df8ac034bed0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.328212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef057-a6da-4eec-8ce2-243b5963122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.329205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef057-a6da-4eec-8ce2-243b5963122b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.329489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef057-a6da-4eec-8ce2-243b5963122b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.329819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef057-a6da-4eec-8ce2-243b5963122b admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/c4579f2065e048128e4718c2a0eff280/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.332328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef057-a6da-4eec-8ce2-243b5963122b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f09e72d52d44edad5f503d25ed1815, user_id=c4579f2065e048128e4718c2a0eff280, role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.335297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef057-a6da-4eec-8ce2-243b5963122b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.368533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 60/124] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:07 2021] PUT /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/c4579f2065e048128e4718c2a0eff280/roles/a6a04d23aca344bc927a9b392991e951 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:07.451668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24ba1-f57a-4ac9-952a-0412e3f238f2 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.451970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24ba1-f57a-4ac9-952a-0412e3f238f2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.452128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24ba1-f57a-4ac9-952a-0412e3f238f2 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.454152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 65/125] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:07.462551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.462551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.462551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.488547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:07.490149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:07.569869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 61/126] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:07.594811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24ba1-f57a-4ac9-952a-0412e3f238f2 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.619936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24ba1-f57a-4ac9-952a-0412e3f238f2 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.624803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.625618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.625901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.626181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.644174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:07.651257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:07.657800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 66/127] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/roles/reader => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:07.659837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.685557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c456a-998b-4120-95d6-1b75a4d08c78 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.692807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.693536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.693827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.694104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.694915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:07.695289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.696911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.710943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 62/128] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.717273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.732213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af314c1e-724a-4788-b239-9df829545d5c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.739634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.740590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.740873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.741149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] PATH_INFO: `/v3/users/6d209175de9f46bb8915e6acd0c1a3ca` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.759095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] RBAC: Authorizing `identity:get_user(user_id=6d209175de9f46bb8915e6acd0c1a3ca)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.761335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.763073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 67/129] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/users/6d209175de9f46bb8915e6acd0c1a3ca => generated 289 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.769365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.779934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159a01-723c-402b-87d2-52c07ca6269b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.787865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.789194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.789486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.789766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.798607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.800507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.814241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 63/130] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:07.820614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.837193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07910a16-a93b-4fbf-9f8c-3119fcc8599d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.841923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a406bf-ae62-4b18-a0cf-8572a3a8a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.842819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a406bf-ae62-4b18-a0cf-8572a3a8a308 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.843133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a406bf-ae62-4b18-a0cf-8572a3a8a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.843416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a406bf-ae62-4b18-a0cf-8572a3a8a308 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.844759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a406bf-ae62-4b18-a0cf-8572a3a8a308 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.846914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a406bf-ae62-4b18-a0cf-8572a3a8a308 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.853800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 68/131] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:07.860344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:07.870879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ac896-998d-46bc-bdac-b5f66189d4cd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:07.879663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:07.880336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:07.880624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:07.880950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:07.881813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] RBAC: Adding query filter params (role.id=9aeef3a1daa84b119d440f786f310585, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=6d209175de9f46bb8915e6acd0c1a3ca) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:07.882214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:07.884238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c754-34cb-41fa-aa27-3918a20e3308 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:07.892748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 64/132] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:07 2021] GET /identity/v3/role_assignments?user.id=6d209175de9f46bb8915e6acd0c1a3ca&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=9aeef3a1daa84b119d440f786f310585 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:08.528400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118477-fa91-4792-a5dc-6e87cc080e5a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:08.529089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118477-fa91-4792-a5dc-6e87cc080e5a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:08.529089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118477-fa91-4792-a5dc-6e87cc080e5a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:08.530894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 69/133] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:08.545020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:08.545593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:08.545593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:08.572217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:08.573420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:08.581108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 65/134] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:08.606622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118477-fa91-4792-a5dc-6e87cc080e5a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:08.619743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118477-fa91-4792-a5dc-6e87cc080e5a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:08.624176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d23b0-885d-442f-895e-c056458921d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:08.624967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d23b0-885d-442f-895e-c056458921d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:08.625250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d23b0-885d-442f-895e-c056458921d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:08.625526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d23b0-885d-442f-895e-c056458921d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:08.626723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d23b0-885d-442f-895e-c056458921d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:08.628473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d23b0-885d-442f-895e-c056458921d3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:08.630258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 70/135] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:08.636853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:08.645931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4653-3ecd-4138-80a1-7f4cfe7fc07f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:08.650466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d175a8-b90b-41ab-9278-90a0bdad4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:08.651143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d175a8-b90b-41ab-9278-90a0bdad4615 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:08.651428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d175a8-b90b-41ab-9278-90a0bdad4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:08.651706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d175a8-b90b-41ab-9278-90a0bdad4615 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:08.652441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d175a8-b90b-41ab-9278-90a0bdad4615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:08.654394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d175a8-b90b-41ab-9278-90a0bdad4615 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:08.682408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 66/136] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:02:08 2021] POST /identity/v3/projects => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:10.422925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d44d-435b-4ffa-a416-5ea5f13e2e2e None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.423948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d44d-435b-4ffa-a416-5ea5f13e2e2e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.424456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d44d-435b-4ffa-a416-5ea5f13e2e2e None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.426428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 71/137] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:10.432292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.433177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.433668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.456231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:10.457716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:10.531987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 67/138] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:10.567500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934d44d-435b-4ffa-a416-5ea5f13e2e2e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.584956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934d44d-435b-4ffa-a416-5ea5f13e2e2e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.590195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798180-5dfb-48a6-ba05-a1c0fd1e7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.591274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798180-5dfb-48a6-ba05-a1c0fd1e7dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.591759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798180-5dfb-48a6-ba05-a1c0fd1e7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.592226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798180-5dfb-48a6-ba05-a1c0fd1e7dc9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.608224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73798180-5dfb-48a6-ba05-a1c0fd1e7dc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:10.615782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-73798180-5dfb-48a6-ba05-a1c0fd1e7dc9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:10.617217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 72/139] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:10.623410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.633870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1be79-9935-4761-bdb9-0a9c29764eed None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.642927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.644042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.644527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.644999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.645963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:10.646464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:10.648929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:10.655178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b306000-426a-4d9b-9e28-5d7b49591969 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.655471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b306000-426a-4d9b-9e28-5d7b49591969 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.655751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b306000-426a-4d9b-9e28-5d7b49591969 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.657997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 73/140] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:10.664832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.664832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.664832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.681624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 68/141] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:10.700384 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.708047 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:10.709242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:10.724024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ffdc3-0dab-4c36-9d6b-d6f9b04fa2de admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.729313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 74/142] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:10.740196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.741062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.741863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.742140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.747764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:10.749918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:10.751586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 69/143] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:10.758089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.772032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a7cd1-8bb6-48df-ba6d-d9f13442d78e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.777972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.782403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c7de8-22d5-4923-a625-f976ad123e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.783336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7de8-22d5-4923-a625-f976ad123e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.783832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7de8-22d5-4923-a625-f976ad123e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.784298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7de8-22d5-4923-a625-f976ad123e41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.792191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e0154-efd1-4b61-a15b-84cd98661002 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.795502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c7de8-22d5-4923-a625-f976ad123e41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:10.797519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c7de8-22d5-4923-a625-f976ad123e41 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:10.807746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 75/144] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:10.809140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.809501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246354-4b83-496e-b8ee-7370fe85c683 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.809928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.810212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.810310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246354-4b83-496e-b8ee-7370fe85c683 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.810481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.810958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246354-4b83-496e-b8ee-7370fe85c683 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.813210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 76/145] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:10.819163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.820255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.820947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.837892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:10.851832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:10.853340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 70/146] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:10.854449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:10.855449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.856832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:10.874048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 77/147] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:10.875527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c44cb-3f9d-4b26-bee4-0c1bb50096a1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.876559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.888439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a37a7-1c9b-41d1-90c7-0eec7df9a366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.889619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a37a7-1c9b-41d1-90c7-0eec7df9a366 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.890090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a37a7-1c9b-41d1-90c7-0eec7df9a366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.890596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a37a7-1c9b-41d1-90c7-0eec7df9a366 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.892429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a37a7-1c9b-41d1-90c7-0eec7df9a366 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:10.895867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a37a7-1c9b-41d1-90c7-0eec7df9a366 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:10.898455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 71/148] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:10.902160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916cd8a-4a84-4d86-a9d1-61d0b90d2a76 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.902612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916cd8a-4a84-4d86-a9d1-61d0b90d2a76 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.903017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916cd8a-4a84-4d86-a9d1-61d0b90d2a76 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.904917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 72/149] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:10.905747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916cd8a-4a84-4d86-a9d1-61d0b90d2a76 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.905983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168060-0b8c-43aa-8e03-5d0525f7f0d3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.914336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.915228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.915654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.916064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.916979 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:10.917424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:10.919211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:10.924188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916cd8a-4a84-4d86-a9d1-61d0b90d2a76 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.929332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 78/150] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:10.930401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.936361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.938034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.938485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.938922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.941673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d44ee-45d1-48c1-9fe8-43feed6a7ec9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.947556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:10.948384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.948769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.949191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.950257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=c4579f2065e048128e4718c2a0eff280) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:10.950677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:10.952813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183a24a-712c-4c9a-9d9e-e509ceb79bfb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:10.953041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:10.959408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 79/151] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/role_assignments?user.id=c4579f2065e048128e4718c2a0eff280&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=087c457f13d74023b2c0f38de56ab52c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:10.960961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:10.961283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:10.961678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:10.962171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:10.962592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 73/152] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:10.971724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:10.987924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:10.988131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4098b-e058-403e-9bb5-4240ffef3e24 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:10.989661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:10.999215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 80/153] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:11.000590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.007638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.007638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.007638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.007638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.008355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.010530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.012502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 74/154] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.020637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.023121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc168f0-bc93-484a-a177-e833a5bf93da None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.030896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.032013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.032527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.033077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.034100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:11.034691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.039384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.043828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85efbe7-4898-4916-81ed-9c887a483f0b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.055917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 81/155] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.061897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.062557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.062837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.063131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.063367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.077096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f58c06-c2f0-4a65-bdc7-6d1783c4522b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.079684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.081464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.082706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.083915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.084475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.084939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] PATH_INFO: `/v3/users/a56319b0d4c140e5b834fcb4b4fa313b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.086680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] RBAC: Authorizing `identity:get_user(user_id=a56319b0d4c140e5b834fcb4b4fa313b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.088924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.091018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 82/156] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/users/a56319b0d4c140e5b834fcb4b4fa313b => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.092130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.102098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 75/157] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:11.104467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.113024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1f5b-6b03-49e3-8f8a-eb7c381834ef admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.123253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.124592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.125480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0dc59-85b7-4567-86f8-1f809e89a154 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.126000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.127339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.134757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0ced-b449-4b80-9c9d-74898898000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.135456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0ced-b449-4b80-9c9d-74898898000d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.135758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0ced-b449-4b80-9c9d-74898898000d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.136022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0ced-b449-4b80-9c9d-74898898000d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.143600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:11.144575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0ced-b449-4b80-9c9d-74898898000d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.146361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0ced-b449-4b80-9c9d-74898898000d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.152249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:11.154112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 83/158] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:11.159983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 76/159] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:11.159983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0389-ec76-467b-b63d-474986b3cdd7 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.159983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0389-ec76-467b-b63d-474986b3cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.159983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0389-ec76-467b-b63d-474986b3cdd7 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.160677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.166014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 77/160] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:11 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:11.166876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0389-ec76-467b-b63d-474986b3cdd7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.173684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35fcb9-84c6-454c-92bb-883d1263ab67 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.179970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.181164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.181594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.182039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] PATH_INFO: `/v3/projects/34e54ecd03fe4378b9390d621a55b8b4` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.183767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] RBAC: Authorizing `identity:get_project(project_id=34e54ecd03fe4378b9390d621a55b8b4)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.185286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0389-ec76-467b-b63d-474986b3cdd7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.187107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.189360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 84/161] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/projects/34e54ecd03fe4378b9390d621a55b8b4 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.190369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.190512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.191272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.191657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.192030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.192915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:11.193338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.195451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec247592-3f5b-4547-a5b2-1d262f67a19e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.206225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5865af-5567-437c-8e1a-9fbb714c46dd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.208265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 78/162] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.209834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.210163 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.210439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.219219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.220471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.221021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.221492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.223153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.226220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.228673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 85/163] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.234981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:11.235456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.236239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:11.246486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 79/164] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:11.255113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.256264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d32b-1e26-4bb4-ae3e-3897622fbc4e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.256842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55f021-1a99-45b3-bf8c-47adc8e6a91d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.268669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.269322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.270187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.270187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.270363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.270724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=34e54ecd03fe4378b9390d621a55b8b4, user.id=c4579f2065e048128e4718c2a0eff280) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:11.271034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.271228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.272261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.272261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] PATH_INFO: `/v3/users/c4579f2065e048128e4718c2a0eff280` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.273511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.273819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] RBAC: Authorizing `identity:get_user(user_id=c4579f2065e048128e4718c2a0eff280)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.276360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.278874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 80/165] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/users/c4579f2065e048128e4718c2a0eff280 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.279683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.280395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 86/166] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/role_assignments?user.id=c4579f2065e048128e4718c2a0eff280&scope.project.id=34e54ecd03fe4378b9390d621a55b8b4&role.id=087c457f13d74023b2c0f38de56ab52c => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.286600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.297976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9f96-910c-460e-b69c-543c56c46ce4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.301796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f2675-7c61-4913-b2bc-ca4a055f2b4f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.308706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.309580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.309687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.309999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.310113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.310657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.310938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.311252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.312117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=a56319b0d4c140e5b834fcb4b4fa313b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:11.312425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.314352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.320917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.322679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 81/167] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/role_assignments?user.id=a56319b0d4c140e5b834fcb4b4fa313b&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.323266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.323671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.334099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343ad3-e43c-4ef7-8cd4-7ede98c45442 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.340865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.341721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.341997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.342269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.343330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 87/168] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:11.350364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.359072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:11.363669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:11.364939 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 82/169] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:11.365839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0796-26da-47f3-8492-7723fffdab44 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.372538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.380806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.382490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.382918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.383361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.385698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8db28-5ff8-431f-b362-01886833ae28 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.387052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.389371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.390828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.391580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 88/170] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:11.395072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.395072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.395072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.395072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:11.395072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.395633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.399822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.410702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 83/171] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.420829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d83aa-538b-4742-9c04-34687adcc169 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.424285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.437232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc773909-c444-44c2-9473-553b1a48c049 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.441053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.441763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.442031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.442298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.446242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] RBAC: Adding query filter params (role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=c4579f2065e048128e4718c2a0eff280) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:11.446571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.449212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.451135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.451788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.452065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.452333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] PATH_INFO: `/v3/users/6d209175de9f46bb8915e6acd0c1a3ca` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.456023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] RBAC: Authorizing `identity:get_user(user_id=6d209175de9f46bb8915e6acd0c1a3ca)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.459859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.466192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 89/173] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/role_assignments?user.id=c4579f2065e048128e4718c2a0eff280&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=a6a04d23aca344bc927a9b392991e951 => generated 608 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.466385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 84/173] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/users/6d209175de9f46bb8915e6acd0c1a3ca => generated 289 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.472362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.484626 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e56e6f-95a3-45e2-ac70-6d7c089cdb5f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.490043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d828e1e-d1d6-4a45-a697-3a845b85b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.490994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828e1e-d1d6-4a45-a697-3a845b85b93c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.491865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828e1e-d1d6-4a45-a697-3a845b85b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.492180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828e1e-d1d6-4a45-a697-3a845b85b93c admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.493677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828e1e-d1d6-4a45-a697-3a845b85b93c admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.495995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828e1e-d1d6-4a45-a697-3a845b85b93c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.498103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 90/174] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:11 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:11.504610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:11.515398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c654-abae-4476-af72-5d78699a8098 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:11.520250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb942-55ff-4433-b6e9-9fe7f3b7da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:11.521224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb942-55ff-4433-b6e9-9fe7f3b7da7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:11.521502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb942-55ff-4433-b6e9-9fe7f3b7da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:11.521773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb942-55ff-4433-b6e9-9fe7f3b7da7e admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/6d209175de9f46bb8915e6acd0c1a3ca/roles/9aeef3a1daa84b119d440f786f310585` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:11.524691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb942-55ff-4433-b6e9-9fe7f3b7da7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f09e72d52d44edad5f503d25ed1815, user_id=6d209175de9f46bb8915e6acd0c1a3ca, role_id=9aeef3a1daa84b119d440f786f310585)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:11.527637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb942-55ff-4433-b6e9-9fe7f3b7da7e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:11.546183 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 85/175] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:11 2021] PUT /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815/users/6d209175de9f46bb8915e6acd0c1a3ca/roles/9aeef3a1daa84b119d440f786f310585 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:12.334253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c860-06fc-4d7c-9220-c1d3291d0eb2 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:12.334536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c860-06fc-4d7c-9220-c1d3291d0eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:12.334814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c860-06fc-4d7c-9220-c1d3291d0eb2 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:12.336636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 91/176] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:12.342380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:12.342669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:12.342947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:12.360356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:12.361525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:12.416737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 86/177] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:12.441854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c860-06fc-4d7c-9220-c1d3291d0eb2 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:12.454550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c860-06fc-4d7c-9220-c1d3291d0eb2 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:12.458752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd8901-d9ea-42a1-b242-327e1ab1edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:12.459546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd8901-d9ea-42a1-b242-327e1ab1edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:12.459829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd8901-d9ea-42a1-b242-327e1ab1edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:12.460107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd8901-d9ea-42a1-b242-327e1ab1edb0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:12.461271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd8901-d9ea-42a1-b242-327e1ab1edb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:12.462973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd8901-d9ea-42a1-b242-327e1ab1edb0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:12.464581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 92/178] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:12.470320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:12.479027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31512-4649-4997-b16c-5e4a80a4de15 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:12.483477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b69e45-1136-4bfd-bc27-07d43e65427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:12.484631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b69e45-1136-4bfd-bc27-07d43e65427d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:12.485144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b69e45-1136-4bfd-bc27-07d43e65427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:12.485635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b69e45-1136-4bfd-bc27-07d43e65427d admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:12.486381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b69e45-1136-4bfd-bc27-07d43e65427d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:12.488568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b69e45-1136-4bfd-bc27-07d43e65427d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:12.509100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 87/179] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:12 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:13.936107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62b8d-912e-4cff-a30d-7cbfc73525fc None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:13.936600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62b8d-912e-4cff-a30d-7cbfc73525fc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:13.936600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62b8d-912e-4cff-a30d-7cbfc73525fc None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:13.938333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 93/180] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:13.944118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:13.945078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:13.945274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:13.962611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:13.963820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:13.971653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 88/181] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:13.996092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62b8d-912e-4cff-a30d-7cbfc73525fc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:14.008985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62b8d-912e-4cff-a30d-7cbfc73525fc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:14.013294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:14.014061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:14.014335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:14.014604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:14.025364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:14.032083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:14.033565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 94/182] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:13 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:14.039704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:14.048492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c14820-69c4-4ee7-ad72-008f6cf0f20b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:14.052911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:14.053561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:14.054375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:14.054643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:14.055432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:14.055730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:14.057329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:14.066034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 89/183] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:14 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:14.072478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:14.082668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c381d-755c-49a0-8700-b53a477e0cc1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:14.087658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:14.088500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:14.088771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:14.089038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] PATH_INFO: `/v3/users/6d209175de9f46bb8915e6acd0c1a3ca` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:14.090242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=6d209175de9f46bb8915e6acd0c1a3ca)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:14.092423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:14.094004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 95/184] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:14 2021] GET /identity/v3/users/6d209175de9f46bb8915e6acd0c1a3ca => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:14.099921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:14.110017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ffe5d-d0f4-43eb-b17c-990f258479f0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:14.114656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:14.115314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:14.115592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:14.115863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:14.123787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:14.125522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:14.134791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 90/185] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:14.140798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:14.151164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0c52-8b69-4db0-b1d8-5927017d67b4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:14.155479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee81d7-e9e5-409b-9240-035938b858c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:14.156304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee81d7-e9e5-409b-9240-035938b858c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:14.156580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee81d7-e9e5-409b-9240-035938b858c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:14.156849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee81d7-e9e5-409b-9240-035938b858c5 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:14.158023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee81d7-e9e5-409b-9240-035938b858c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:14.160099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee81d7-e9e5-409b-9240-035938b858c5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:14.161732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 96/186] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:14 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:14.168060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:14.176739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc95c0-f979-4263-99c1-fe6a0acbe45c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:14.181127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:14.181757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:14.182033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:14.182302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:14.183158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] RBAC: Adding query filter params (role.id=9aeef3a1daa84b119d440f786f310585, scope.project.id=d7f09e72d52d44edad5f503d25ed1815, user.id=6d209175de9f46bb8915e6acd0c1a3ca) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:14.183465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:14.185270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a24cb-1b06-4ae1-b41b-bfd1dd4474aa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:14.191138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 91/187] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:14 2021] GET /identity/v3/role_assignments?user.id=6d209175de9f46bb8915e6acd0c1a3ca&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=9aeef3a1daa84b119d440f786f310585 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:15.019059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5c2a-734f-48a8-ae58-63bde40693d9 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.019566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5c2a-734f-48a8-ae58-63bde40693d9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.019566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5c2a-734f-48a8-ae58-63bde40693d9 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.021446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 97/188] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:15.026919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295aa4e-4c9a-4637-896e-a6b4aa8c2a48 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.027348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295aa4e-4c9a-4637-896e-a6b4aa8c2a48 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.027500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295aa4e-4c9a-4637-896e-a6b4aa8c2a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.045600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b295aa4e-4c9a-4637-896e-a6b4aa8c2a48 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:15.046764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b295aa4e-4c9a-4637-896e-a6b4aa8c2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:15.054891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 92/189] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:15.078000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e5c2a-734f-48a8-ae58-63bde40693d9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.089764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e5c2a-734f-48a8-ae58-63bde40693d9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.093982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.094747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.095025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.095319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.105899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:15.112821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:15.114117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 98/190] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:15.115184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb372-c415-4310-bdec-7fece5246d6e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.115476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb372-c415-4310-bdec-7fece5246d6e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.115750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb372-c415-4310-bdec-7fece5246d6e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.118197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 93/191] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:15.120982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.123265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.123550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.123820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.131926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa654171-7e04-4f9c-9470-4f9a9897a36e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.136242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.136884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.137168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.137446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.138204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:15.138507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.140135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bae2b-ebc3-4ed6-b2a3-03abb39df0f6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.141210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:15.142366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:15.149406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 99/192] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:15.150124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 94/193] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:15.154259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bb23c-ea41-4992-aebf-82047427f4f4 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.154558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bb23c-ea41-4992-aebf-82047427f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.154839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bb23c-ea41-4992-aebf-82047427f4f4 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.155948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.156657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 100/194] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:15.161829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.162117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.162398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.165807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb208d3-a146-41a3-b260-5840c65bec91 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.170000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.170850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.171158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.171434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] PATH_INFO: `/v3/users/10bdbcfa90584a92b73e51a2d524230d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.181411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:15.182598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:15.185071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] RBAC: Authorizing `identity:get_user(user_id=10bdbcfa90584a92b73e51a2d524230d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.187230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.188853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 95/195] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/users/10bdbcfa90584a92b73e51a2d524230d => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:15.190277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 101/196] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:15.190829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.194591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.199847 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4b61d-a395-41f3-b7a3-f70e92fdb635 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.203514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0018cac-33ec-4b82-bd7e-d191166a86d5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.204011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.204782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.205050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.205312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.208197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.208806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.209089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.209363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.215420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:15.217225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.218974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.222439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:15.223723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 96/197] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:15.224333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.228478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 102/198] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:15.233818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72b7c-1281-4b0f-91a5-1bcd25e0a890 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.233938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.238245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.238950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.239249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.239518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.240664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.242902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.243003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d84e-1757-4bf7-934d-9296a6039cf9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.244612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 97/199] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:15.245161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.251549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.252351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.252658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.252932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.254095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.256150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.257333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4339e7-1ced-44d2-b0fa-4b0d17c1586e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.257769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 103/200] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:15.258472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.261699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.262290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.262582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.262836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.263578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:15.263876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.265388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.267517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341782-59f7-4c8e-bd8a-64ad4c7f8171 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.271762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.272283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.273062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.273332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.274023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.274397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 98/201] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:15.275181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.275901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.284265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e76a5-0723-40d9-ab71-f43be2a88768 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.290724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.291589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.291868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.292136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.292967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=10bdbcfa90584a92b73e51a2d524230d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:15.293274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.295135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.296256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 104/202] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:15 2021] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:15.307332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.307445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 99/203] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/role_assignments?user.id=10bdbcfa90584a92b73e51a2d524230d&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:15.308446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2ae92-679b-43aa-a072-d38d11c2809b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.313144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.314078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.314359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.314629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] PATH_INFO: `/v3/users/10bdbcfa90584a92b73e51a2d524230d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.316227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=10bdbcfa90584a92b73e51a2d524230d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.318673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.320815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 105/204] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/users/10bdbcfa90584a92b73e51a2d524230d => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:15.327333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.338706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07ba2d-4b95-471c-a7b4-112c2e9eed0c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.343471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.344252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.344526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.344793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.354483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.356348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.367259 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 100/205] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:15.373554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.384234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7ece9-63d3-4d2a-a66a-4301b48829e9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.388736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb2ceb-fcbb-4395-8184-7f7dc34499f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.389639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb2ceb-fcbb-4395-8184-7f7dc34499f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.389927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb2ceb-fcbb-4395-8184-7f7dc34499f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.390199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb2ceb-fcbb-4395-8184-7f7dc34499f2 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.391616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb2ceb-fcbb-4395-8184-7f7dc34499f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.393744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb2ceb-fcbb-4395-8184-7f7dc34499f2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.395837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 106/206] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:15.402776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:15.412065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce90f-9840-44bb-8c23-2db92c6a4154 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:15.417258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:15.417918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:15.418193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:15.418462 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:15.419351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] RBAC: Adding query filter params (role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=10bdbcfa90584a92b73e51a2d524230d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:15.419664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:15.421537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e2c17-656f-4ea8-8e7e-68c0205b0842 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:15.428111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 101/207] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:15 2021] GET /identity/v3/role_assignments?user.id=10bdbcfa90584a92b73e51a2d524230d&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=a6a04d23aca344bc927a9b392991e951 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:17.704928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28cab-b764-461a-971b-14e02c76de9a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.705449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28cab-b764-461a-971b-14e02c76de9a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.705449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28cab-b764-461a-971b-14e02c76de9a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.707546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 107/208] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:17.713412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.713814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.713987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.731943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:17.733134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:17.741591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 102/209] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:17.765115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28cab-b764-461a-971b-14e02c76de9a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.777483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28cab-b764-461a-971b-14e02c76de9a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:17.781764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27e692-e4e3-4e87-bf03-91e353dc0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:17.782539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27e692-e4e3-4e87-bf03-91e353dc0778 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.782824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27e692-e4e3-4e87-bf03-91e353dc0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.783127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27e692-e4e3-4e87-bf03-91e353dc0778 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.793762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27e692-e4e3-4e87-bf03-91e353dc0778 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:17.800656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-1a27e692-e4e3-4e87-bf03-91e353dc0778 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:17.801874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 108/210] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:17.808805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.812538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f33c-4ee2-47a8-beec-c432ec9fe0ad None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.813036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f33c-4ee2-47a8-beec-c432ec9fe0ad None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.813512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f33c-4ee2-47a8-beec-c432ec9fe0ad None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.815810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 109/211] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:17.817994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701a52-2a15-42b3-b79b-53f444faad34 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:17.822502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ede89-9264-4a2a-9895-d534f256d77f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.823016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:17.823161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ede89-9264-4a2a-9895-d534f256d77f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.823629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ede89-9264-4a2a-9895-d534f256d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.823726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.823965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.824237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.825002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:17.825310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:17.827157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:17.837726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 103/212] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:17.843740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.847000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0c1ede89-9264-4a2a-9895-d534f256d77f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:17.848436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0c1ede89-9264-4a2a-9895-d534f256d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:17.853757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7059-a0e8-451d-bfc6-18275d2cb7d8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:17.858249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 110/213] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:17.858716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:17.859895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.860389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.860855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] PATH_INFO: `/v3/users/10bdbcfa90584a92b73e51a2d524230d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.863814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] RBAC: Authorizing `identity:get_user(user_id=10bdbcfa90584a92b73e51a2d524230d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:17.866758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:17.867007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a157-1a6d-4841-9fe4-46205b80465d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.867338 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a157-1a6d-4841-9fe4-46205b80465d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.867615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a157-1a6d-4841-9fe4-46205b80465d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.869220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 104/214] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/users/10bdbcfa90584a92b73e51a2d524230d => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:17.869466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 111/215] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:17.874765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.875070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.875355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.875699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.890049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bdf1f-8b64-4f06-9171-08de6531386b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:17.893821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:17.894568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:17.894994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:17.895457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.895741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.896016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.897201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:17.899284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:17.901093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 105/216] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:17.906014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.907433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 112/217] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:17.911820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.917599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dffe55-b3b3-40b5-bdbc-6302a4a862de admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:17.921939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bba7b-891e-493e-8a9b-a86c9dfc060f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:17.922668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:17.923884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.924370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.924853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.926414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:17.927387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:17.927752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:17.928098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/10bdbcfa90584a92b73e51a2d524230d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:17.930786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf4edfa0de424eac9c77cffbd654dd, user_id=10bdbcfa90584a92b73e51a2d524230d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:17.933641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:17.938519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:17.946286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:17.946607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 113/218] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:17 2021] PUT /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/10bdbcfa90584a92b73e51a2d524230d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:17.947429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.952229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 106/219] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:17.964341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:17.976239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872b26-ceb6-40df-8945-f3824488bf4b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.025825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097f4e-f60d-46af-ad45-c52322b3d473 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.030990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551ac81-3ca8-4342-896f-b68436accfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.031822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551ac81-3ca8-4342-896f-b68436accfbe admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.032101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551ac81-3ca8-4342-896f-b68436accfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.032373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551ac81-3ca8-4342-896f-b68436accfbe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.033575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551ac81-3ca8-4342-896f-b68436accfbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.035360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551ac81-3ca8-4342-896f-b68436accfbe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.037226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 114/220] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:18.038920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1860d-f171-4f58-a0d3-4fe1032bf3de None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.039228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1860d-f171-4f58-a0d3-4fe1032bf3de None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.039497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1860d-f171-4f58-a0d3-4fe1032bf3de None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.041369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 115/221] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:18.042725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.043584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.043950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.044227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1860d-f171-4f58-a0d3-4fe1032bf3de None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.044346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.045023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:18.045335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.046976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d636c-dc04-498a-a7cc-f2a5fa4024ee admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.056665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 107/222] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:18.057816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.058104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.058376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.061053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1860d-f171-4f58-a0d3-4fe1032bf3de None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.065837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.066506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.066783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.067068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.067820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.069783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.076636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:18.077874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:18.095065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 108/223] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:18.095065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.097666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f4fdf-3e69-4f86-9b1f-dd026dfa7c83 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.100216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 116/224] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:18 2021] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:02:18.112894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.113958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.114543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.115332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] PATH_INFO: `/v3/users/10bdbcfa90584a92b73e51a2d524230d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.115676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.118116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] RBAC: Authorizing `identity:get_user(user_id=10bdbcfa90584a92b73e51a2d524230d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.120889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.123482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 109/225] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/users/10bdbcfa90584a92b73e51a2d524230d => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:18.130163 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.133474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840f9a3-27ca-4ae9-afbf-099c008326a2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.144642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864cca3-342a-4e61-981f-29874c25869f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.147850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.148664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.148938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.149208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.155768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.157203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.158006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.158976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.160671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.162170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:18.164733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.171538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:18.172241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 110/226] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:18.174490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.176385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 117/227] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:18.177347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.189011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffce89-65e7-4063-95f7-6d60dc04b19a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.190082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091b4e3-01d6-481f-81b2-dcb5eef6cfdc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.194346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.195019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.195325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.195595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.196104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.196372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:18.196673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.196991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.197269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.197880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/10bdbcfa90584a92b73e51a2d524230d/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.198368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.200010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf4edfa0de424eac9c77cffbd654dd, user_id=10bdbcfa90584a92b73e51a2d524230d, role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.202912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.208267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 118/228] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:18.215723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.219115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 111/229] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:18 2021] PUT /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/10bdbcfa90584a92b73e51a2d524230d/roles/a6a04d23aca344bc927a9b392991e951 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:02:18.227794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ecd38-cc58-4728-a0ef-f3127f92ebbb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.303945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.305467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.305979 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.306473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] PATH_INFO: `/v3/users/cb96856989df400791f876f9325e3080` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.324100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb96856989df400791f876f9325e3080)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.326892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.330138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 119/230] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/users/cb96856989df400791f876f9325e3080 => generated 297 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:18.336792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.347818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a60cd-4d7e-4e7a-aa81-f9cf0a451996 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.354165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.354834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.355239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.355569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.365088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.366958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.377461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 112/231] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:18.383753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.394138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09185b-2de1-4648-ae4f-a4539c6d4e56 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.399678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cdfd4-f50b-4bd9-b60b-7a7ecef38a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.400629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cdfd4-f50b-4bd9-b60b-7a7ecef38a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.400894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cdfd4-f50b-4bd9-b60b-7a7ecef38a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.401219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cdfd4-f50b-4bd9-b60b-7a7ecef38a37 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.402570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cdfd4-f50b-4bd9-b60b-7a7ecef38a37 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.404758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cdfd4-f50b-4bd9-b60b-7a7ecef38a37 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.406938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 120/232] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:18.414273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:18.423583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473f3ea-2b47-4642-a907-b0398e83d585 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:18.428175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:18.428882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:18.429156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:18.429425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:18.430273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=cb96856989df400791f876f9325e3080) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:18.430577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:18.432468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72255-252b-4e5b-a4c8-63da5f3c5620 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:18.438802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 113/233] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:18 2021] GET /identity/v3/role_assignments?user.id=cb96856989df400791f876f9325e3080&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=087c457f13d74023b2c0f38de56ab52c => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:20.969834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e348859-7e20-4948-8441-c7d6d82f90b8 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:20.970483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e348859-7e20-4948-8441-c7d6d82f90b8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:20.970483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e348859-7e20-4948-8441-c7d6d82f90b8 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:20.972206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 121/234] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:20.978957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872173-7ca7-4236-b926-881f7383ba7d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:20.979256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872173-7ca7-4236-b926-881f7383ba7d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:20.979527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872173-7ca7-4236-b926-881f7383ba7d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:20.981155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 122/235] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:20.981689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:20.982244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:20.982244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:20.989458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:20.989737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:20.990003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.015981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:21.017155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:21.019165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:21.020295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:21.032321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 123/236] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:21.034307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 114/237] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:21.070637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.080681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.089763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df4d2d-8173-4297-b93f-52ec35da1f34 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.094160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33efc4-78fb-4b15-bc9d-d900c87b98eb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.099600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.100416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.100689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.100955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.104021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.104791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.105063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.105332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.123117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:21.124035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:21.129954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:21.131348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 124/238] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles/reader => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:21.135804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:21.137738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.138422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 115/239] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:21.143475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.148586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ebe3b-5ef9-4382-b862-0a22cab10832 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.154356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7796-7284-451e-a256-c6cc4fbbb57e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.158484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.159163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.159443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.159714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.160472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.160769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.162365 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.168703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.169355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.169628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.169896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.170712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.170943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.172530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.184339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 125/240] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.191977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 116/241] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:21.193189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.198254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.204564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404f41c-ca6f-4949-9c8a-b768e5c4eecb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.210597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.211712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.211905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fca06-1088-490d-92a4-f3f842a227d6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.212382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.212903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] PATH_INFO: `/v3/users/3dc0a46316bf4e1fb660380bad210734` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.224760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.225595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.225880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.226155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] PATH_INFO: `/v3/users/10bdbcfa90584a92b73e51a2d524230d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.228558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] RBAC: Authorizing `identity:get_user(user_id=3dc0a46316bf4e1fb660380bad210734)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.230918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.231788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] RBAC: Authorizing `identity:get_user(user_id=10bdbcfa90584a92b73e51a2d524230d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.233052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 126/242] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/users/3dc0a46316bf4e1fb660380bad210734 => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:21.238580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.238580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 117/243] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/users/10bdbcfa90584a92b73e51a2d524230d => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:21.239859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.244423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.251371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f85d-e4d9-41b4-b9b8-fa36bd28c6ce admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.255870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503de15-500a-479f-9968-fe3ec7b08aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.256632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc324a-c751-4cc5-bda5-f604072a4526 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.257359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503de15-500a-479f-9968-fe3ec7b08aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.257769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503de15-500a-479f-9968-fe3ec7b08aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.258278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503de15-500a-479f-9968-fe3ec7b08aa4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.262010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.262745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.263158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.263534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.267914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503de15-500a-479f-9968-fe3ec7b08aa4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.269980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503de15-500a-479f-9968-fe3ec7b08aa4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.271910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.273789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.279661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 127/244] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:21.285872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 118/245] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:21.286069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f96b0-7656-42e3-b5e8-26645f4546f0 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.286521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f96b0-7656-42e3-b5e8-26645f4546f0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.286943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f96b0-7656-42e3-b5e8-26645f4546f0 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.287134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.289731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 128/246] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:21 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:21.290632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f96b0-7656-42e3-b5e8-26645f4546f0 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.297801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6023a-76d4-4ff2-8160-312953f513c9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.302337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967136bf-9717-4f67-981f-672967191a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.303291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f96b0-7656-42e3-b5e8-26645f4546f0 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.303952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967136bf-9717-4f67-981f-672967191a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.304308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967136bf-9717-4f67-981f-672967191a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.304655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967136bf-9717-4f67-981f-672967191a9c admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.305916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967136bf-9717-4f67-981f-672967191a9c admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.308113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967136bf-9717-4f67-981f-672967191a9c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.308472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db456-f2fd-4c0f-9b01-b1d4174c9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.309364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db456-f2fd-4c0f-9b01-b1d4174c9a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.309704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db456-f2fd-4c0f-9b01-b1d4174c9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.310278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db456-f2fd-4c0f-9b01-b1d4174c9a91 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.310381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 119/247] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.311453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.311762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.312150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.316327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db456-f2fd-4c0f-9b01-b1d4174c9a91 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.318429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db456-f2fd-4c0f-9b01-b1d4174c9a91 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.320890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 129/248] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.325898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aa95a-4b35-48e7-b179-f5abdc8bf461 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.325898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aa95a-4b35-48e7-b179-f5abdc8bf461 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.325898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aa95a-4b35-48e7-b179-f5abdc8bf461 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.325898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 130/249] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:21.325898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aa95a-4b35-48e7-b179-f5abdc8bf461 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.334321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:21.335561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:21.337930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aa95a-4b35-48e7-b179-f5abdc8bf461 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.342338 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.343034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.347132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 120/250] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:21.347251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.347251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.347421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.347500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] RBAC: Adding query filter params (role.id=9aeef3a1daa84b119d440f786f310585, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=3dc0a46316bf4e1fb660380bad210734) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.347500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.347500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c0a6e-86b3-4d48-86c1-76f2ec814805 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.353488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617b51b-b2be-4d63-b01e-46ee5f0098c5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.355523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 131/251] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/role_assignments?user.id=3dc0a46316bf4e1fb660380bad210734&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=9aeef3a1daa84b119d440f786f310585 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.356781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.357068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.357345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.358277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.359057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.359445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.359790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.360718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=10bdbcfa90584a92b73e51a2d524230d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.361090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.363422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.378048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:21.379084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 121/252] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/role_assignments?user.id=10bdbcfa90584a92b73e51a2d524230d&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.379599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:21.380440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.389587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 132/253] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:21.393815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81496-5f2c-4e96-8e31-c9a53369f0c7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.398766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69e3d3-63e7-475d-9fe7-619db11aa77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.399905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69e3d3-63e7-475d-9fe7-619db11aa77d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.400365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69e3d3-63e7-475d-9fe7-619db11aa77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.400815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69e3d3-63e7-475d-9fe7-619db11aa77d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.413871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69e3d3-63e7-475d-9fe7-619db11aa77d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:21.416096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.423142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0a69e3d3-63e7-475d-9fe7-619db11aa77d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:21.431086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a532b1-80ca-4a2b-9724-0cb5258c0cf1 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.431293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 122/254] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:21.431293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e583c-1fa9-4975-a8bb-3b1e0838168b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.431293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e583c-1fa9-4975-a8bb-3b1e0838168b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.431293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e583c-1fa9-4975-a8bb-3b1e0838168b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.432263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 123/255] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:21.434074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e583c-1fa9-4975-a8bb-3b1e0838168b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.438904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d49810-d57b-4b3a-9434-7eb51576ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.439744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49810-d57b-4b3a-9434-7eb51576ad20 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.440028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49810-d57b-4b3a-9434-7eb51576ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.440294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49810-d57b-4b3a-9434-7eb51576ad20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.441516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d49810-d57b-4b3a-9434-7eb51576ad20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.447078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d49810-d57b-4b3a-9434-7eb51576ad20 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.447078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 133/256] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:21.447078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.447078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.450234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e583c-1fa9-4975-a8bb-3b1e0838168b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.452465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.455088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.455841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.456196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.456540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.457392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.457771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.459525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.472518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 124/257] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:21.473915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:21.476064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:21.479294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.484728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 134/258] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:21.485928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.490560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95179f97-d99e-4037-946e-a161317478ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.496523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c58f10-9828-4503-bb61-121d918679b0 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.496710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.497357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.497714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.498049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.498880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.500967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.502488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.503660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.504119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.504566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] PATH_INFO: `/v3/users/cb96856989df400791f876f9325e3080` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.506002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb96856989df400791f876f9325e3080)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.508553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.510619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 135/259] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/users/cb96856989df400791f876f9325e3080 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.523534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.534585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 125/260] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:21 2021] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:21.536303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.550599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390568a7-dd5f-4538-8a12-04d2b10a7afb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.551093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7e01-b7e0-4a7c-bd63-d797c6cc21f7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.559243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.560224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.561387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.562663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.563285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.563767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.564231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.564695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.567345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.575135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.582679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 136/261] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.585889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.592393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:21.603825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b50e2-4614-4fcd-804a-dd7e91619011 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.606723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:21.608368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 126/262] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:21.610679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.614145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.614145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.614145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/cb96856989df400791f876f9325e3080/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.615736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.615847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf4edfa0de424eac9c77cffbd654dd, user_id=cb96856989df400791f876f9325e3080, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.618912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.630740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef587-1481-4ef6-84eb-04aa31c45441 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.643072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 137/263] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:21 2021] PUT /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/cb96856989df400791f876f9325e3080/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:21.713004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.713706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.713991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.714273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.715147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.715467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.717189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.731380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 127/264] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.737499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.754214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe259df-a20e-4687-8b9c-406e11491c3a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.767055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.768001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.768281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.768548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] PATH_INFO: `/v3/users/10bdbcfa90584a92b73e51a2d524230d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.773557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] RBAC: Authorizing `identity:get_user(user_id=10bdbcfa90584a92b73e51a2d524230d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.775985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.778272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 138/265] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/users/10bdbcfa90584a92b73e51a2d524230d => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.784920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.798042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cd3f-9fe8-4793-af6c-a4acfa1d47bc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.804920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.806147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.806650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.807180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.816796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.818583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.830648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 128/266] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:21.837554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.847796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44263ab-6359-4c87-82c6-77d3119af82c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.852486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef4e09-826e-4dd9-9b69-d273e756e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.853360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4e09-826e-4dd9-9b69-d273e756e554 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.853643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4e09-826e-4dd9-9b69-d273e756e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.853988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4e09-826e-4dd9-9b69-d273e756e554 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.855267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef4e09-826e-4dd9-9b69-d273e756e554 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.857361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef4e09-826e-4dd9-9b69-d273e756e554 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.859330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 139/267] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:21.866050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:21.876904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4eeb9-3e58-4d58-a20c-00f96dbcda84 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:21.884371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:21.885047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:21.885330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:21.885606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:21.886531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] RBAC: Adding query filter params (role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=10bdbcfa90584a92b73e51a2d524230d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:21.886850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:21.888791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2aba-445b-4fd0-9a20-b43bdd269a94 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:21.895887 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 129/268] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:21 2021] GET /identity/v3/role_assignments?user.id=10bdbcfa90584a92b73e51a2d524230d&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=a6a04d23aca344bc927a9b392991e951 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:23.895669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992988f-e4af-4555-8c9c-9d2a97ad4ae5 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:23.895669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992988f-e4af-4555-8c9c-9d2a97ad4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:23.895669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992988f-e4af-4555-8c9c-9d2a97ad4ae5 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:23.897041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 140/269] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:23.903590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:23.904511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:23.904989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:23.923596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:23.925042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:23.933464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 130/270] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:23.956558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992988f-e4af-4555-8c9c-9d2a97ad4ae5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:23.969089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992988f-e4af-4555-8c9c-9d2a97ad4ae5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:23.973753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:23.974781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:23.975825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:23.976317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:23.987442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:23.995387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:23.996945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 141/271] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:23 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:24.003530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.012695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4fe4c-f517-4d68-be1c-175359d3f9cd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.017341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.018213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.018790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.019635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.020590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:24.021098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.022973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.031739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 131/272] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.038728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.049282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b92bd-f971-4cc6-b352-3d5a7259eeeb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.054533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.055665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.056172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.056641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] PATH_INFO: `/v3/users/3dc0a46316bf4e1fb660380bad210734` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.058059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3dc0a46316bf4e1fb660380bad210734)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.060410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.062211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 142/273] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/users/3dc0a46316bf4e1fb660380bad210734 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.068448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.078755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a837533-c033-45d4-91b4-7a6f44f254f3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.083400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f58f1-363c-4bae-9105-78000ce4a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.084478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f58f1-363c-4bae-9105-78000ce4a9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.084990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f58f1-363c-4bae-9105-78000ce4a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.085491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f58f1-363c-4bae-9105-78000ce4a9f2 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.086881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f58f1-363c-4bae-9105-78000ce4a9f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.089123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f58f1-363c-4bae-9105-78000ce4a9f2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.090985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 132/274] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.097405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.107957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeff38-6f9e-44a2-b4b1-cac4214211a3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.112841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.114043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.114527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.114992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c7ae-8032-4816-bc44-c6d5f8ec858b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.115250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/3dc0a46316bf4e1fb660380bad210734/roles/9aeef3a1daa84b119d440f786f310585` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.115359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c7ae-8032-4816-bc44-c6d5f8ec858b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.115562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c7ae-8032-4816-bc44-c6d5f8ec858b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.117876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 133/275] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:24.118535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf4edfa0de424eac9c77cffbd654dd, user_id=3dc0a46316bf4e1fb660380bad210734, role_id=9aeef3a1daa84b119d440f786f310585)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.121484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.123118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2e3b-c199-4a77-9fb2-cbb5cac59db7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.123404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2e3b-c199-4a77-9fb2-cbb5cac59db7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.123680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2e3b-c199-4a77-9fb2-cbb5cac59db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.136161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 143/276] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:24 2021] PUT /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/users/3dc0a46316bf4e1fb660380bad210734/roles/9aeef3a1daa84b119d440f786f310585 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:24.143070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3d8c2e3b-c199-4a77-9fb2-cbb5cac59db7 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:24.144443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3d8c2e3b-c199-4a77-9fb2-cbb5cac59db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:24.213833 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 134/277] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:24.240051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.251744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d151a7-b5fb-4c48-b9d8-394f0074db0c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.256561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.257455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.257805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.258176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.270940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:24.278521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe13294-bbf5-4719-94bc-d67b771f9529 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.278837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:24.278937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe13294-bbf5-4719-94bc-d67b771f9529 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.279130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe13294-bbf5-4719-94bc-d67b771f9529 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.280208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 144/278] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:24.281143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 135/279] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:24.286576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.287559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c207f-283a-4c52-9723-c5e52e051166 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.288616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c207f-283a-4c52-9723-c5e52e051166 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.289096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c207f-283a-4c52-9723-c5e52e051166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.297585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cecc38-3892-4678-bb4c-b2a917e9d1a3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.302845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.303588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.303867 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.304142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.304929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:24.305232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.306929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.311264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f12c207f-283a-4c52-9723-c5e52e051166 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:24.312817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f12c207f-283a-4c52-9723-c5e52e051166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:24.317513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 145/280] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.322626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 136/281] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:24.331156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.334402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b28f58-46d9-4186-bd82-b0d760cf665b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.336202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff423-9ff4-43c6-9683-947e7cafbf2f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.336485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff423-9ff4-43c6-9683-947e7cafbf2f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.336753 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff423-9ff4-43c6-9683-947e7cafbf2f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.343963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.344152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 137/282] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:24 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:24.345196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.345416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.345514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.345704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.345950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] PATH_INFO: `/v3/users/cb96856989df400791f876f9325e3080` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.346055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.347707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb96856989df400791f876f9325e3080)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.350208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.352692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 146/283] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/users/cb96856989df400791f876f9325e3080 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:24.353327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.364923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:24.366152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:24.371357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea519e-e970-4445-b608-2991501296d1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.377731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 138/284] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:24.379774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.380515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.381588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.381870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.382143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.392598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df4e40-c714-4ef1-af2c-b9c0320eb481 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.394301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:24.402116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:24.403277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 147/285] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:24.403929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.407757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.408710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.409171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.409453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.413909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db53953-6cf9-4a6b-b629-84b25fd45662 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.418233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.418373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.418964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.419274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.419547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.420124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.420694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.422389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.424131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 148/286] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.427681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.432929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 139/287] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:24.433659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.438129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32195-f92b-4d03-ac62-57536bbd4cb3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.442244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e1e91-f398-4ff0-ac13-ef28019d23c5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.442449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.443090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.443478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.443754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.444533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:24.444841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.446403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.446866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.447534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.447807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.448075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.448773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.450628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.455563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 149/288] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.456558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.471127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b2e8a-a6dc-43ac-a448-58692cc3ce0e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.472062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 140/289] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:24 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:24.472780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.483417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.484901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.485963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.486405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.488670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.489900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d63fc-4034-4f09-876c-2ba035d23ba1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.491421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.493962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 150/290] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.503103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.503103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.503103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.503103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] PATH_INFO: `/v3/users/0fd3b9f2a1ce41b8bef56e8eb89699d2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.503567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.518530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] RBAC: Authorizing `identity:get_user(user_id=0fd3b9f2a1ce41b8bef56e8eb89699d2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.520926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.521547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21c62-cf33-4ca6-b3da-865993f9f33a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.527126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 141/291] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/users/0fd3b9f2a1ce41b8bef56e8eb89699d2 => generated 293 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:24.530758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:24.536700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.538532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.539083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.539587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.540781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=cb96856989df400791f876f9325e3080) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:24.541410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.542703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1cbda-0fca-48bd-8890-704c44306695 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:24.544547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3427d-0c23-43c7-880d-50d61ec6a008 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.547627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:24.548295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:24.548576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:24.548860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:24.549715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, user.id=0fd3b9f2a1ce41b8bef56e8eb89699d2, scope.system=all) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:24.550018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:24.551909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89534b09-b035-4f81-9f04-7c701ec81ceb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:24.554337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 151/292] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/role_assignments?user.id=cb96856989df400791f876f9325e3080&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=087c457f13d74023b2c0f38de56ab52c => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:24.560811 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 142/293] 10.222.0.43 () {56 vars in 1329 bytes} [Tue Dec 14 03:02:24 2021] GET /identity/v3/role_assignments?user.id=0fd3b9f2a1ce41b8bef56e8eb89699d2&scope.system=all&role.id=087c457f13d74023b2c0f38de56ab52c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:26.571567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75554a-0590-4a1e-8849-70fb89ec9bf7 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.571567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75554a-0590-4a1e-8849-70fb89ec9bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.571567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75554a-0590-4a1e-8849-70fb89ec9bf7 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.572599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 152/294] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:26.579154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.580006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.580436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.600728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:26.602202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:26.610349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 143/295] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:26.635359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75554a-0590-4a1e-8849-70fb89ec9bf7 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:26.648607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75554a-0590-4a1e-8849-70fb89ec9bf7 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:26.653214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:26.654185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.657430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.657898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.671892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:26.679320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:26.680876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 153/296] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:26 2021] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:26.687679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:26.697403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62623ec8-b150-4399-9eaa-8d3b8c8017e3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:26.702346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:26.703247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.703709 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.704159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.705092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:26.705598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:26.707401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:26.721874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 144/297] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:26 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:26.723437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:26.735141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a959-1aa5-4201-934d-736c3a7548c5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:26.740104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:26.741176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.741633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.742079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] PATH_INFO: `/v3/users/3dc0a46316bf4e1fb660380bad210734` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.743499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=3dc0a46316bf4e1fb660380bad210734)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:26.745806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:26.747610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 154/298] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:26 2021] GET /identity/v3/users/3dc0a46316bf4e1fb660380bad210734 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:26.753881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:26.764098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf5e3b-b00d-42e5-a836-ebb54dbf547c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:26.769230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:26.770104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.770573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.771027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.780273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:26.782257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:26.797127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 145/299] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:26.798663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:26.808816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743fb57-45da-495e-8d39-b52660cb38b2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:26.813413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9620-842c-4ec9-a6ad-74863077aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:26.814456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9620-842c-4ec9-a6ad-74863077aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.814914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9620-842c-4ec9-a6ad-74863077aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.815384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9620-842c-4ec9-a6ad-74863077aa0b admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.816745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9620-842c-4ec9-a6ad-74863077aa0b admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:26.819080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9620-842c-4ec9-a6ad-74863077aa0b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:26.826183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 155/300] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:26 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:26.827716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:26.837266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d065-4bac-47a5-b1ea-f6bdbfb2c9ff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:26.841989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:26.842825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.843340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.843792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.844808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] RBAC: Adding query filter params (role.id=9aeef3a1daa84b119d440f786f310585, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd, user.id=3dc0a46316bf4e1fb660380bad210734) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:26.845293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:26.847335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3e248-02d2-4b00-9acd-bdb48170f2ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:26.859155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 146/301] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:26 2021] GET /identity/v3/role_assignments?user.id=3dc0a46316bf4e1fb660380bad210734&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=9aeef3a1daa84b119d440f786f310585 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:26.976865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6bd27-537a-4a4b-9e3a-f9a918cba2f2 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.977146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6bd27-537a-4a4b-9e3a-f9a918cba2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.977422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6bd27-537a-4a4b-9e3a-f9a918cba2f2 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:26.979246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 156/302] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:26.985617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df9f9-9e9b-489d-9847-a71e3517cea7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:26.985904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df9f9-9e9b-489d-9847-a71e3517cea7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:26.986188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df9f9-9e9b-489d-9847-a71e3517cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.005180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b64df9f9-9e9b-489d-9847-a71e3517cea7 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:27.006928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b64df9f9-9e9b-489d-9847-a71e3517cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:27.014962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73cb6-7d32-4831-be87-3da422d0945b None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.015277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73cb6-7d32-4831-be87-3da422d0945b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.015557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73cb6-7d32-4831-be87-3da422d0945b None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.015661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 147/303] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:27.017390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 157/304] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:27.023998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.024330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.024553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.040453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d73cb6-7d32-4831-be87-3da422d0945b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.043267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:27.044474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:27.052405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 148/305] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:27.054538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d73cb6-7d32-4831-be87-3da422d0945b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.059236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.060326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.060829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.061287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.073357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:27.076837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.081425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:27.083519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 158/306] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:27.089680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fd47-a147-43e2-9eca-3bdb810ba67c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.090897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.094250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f467f-b192-4409-9ecf-73682d3c84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.095033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f467f-b192-4409-9ecf-73682d3c84fc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.095338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f467f-b192-4409-9ecf-73682d3c84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.095607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f467f-b192-4409-9ecf-73682d3c84fc admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.102273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc5c8-0818-45a3-ba84-352939ce5fdc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.107418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f467f-b192-4409-9ecf-73682d3c84fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:27.108972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.109874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.110152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.110423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.111241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:27.111522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.113384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.114511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-335f467f-b192-4409-9ecf-73682d3c84fc admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:27.115778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 149/307] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:27.116995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b531-69c2-4c84-befd-5d0fe9da25aa None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.117283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b531-69c2-4c84-befd-5d0fe9da25aa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.117553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b531-69c2-4c84-befd-5d0fe9da25aa None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.123289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 159/308] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:27.124229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 150/309] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:27 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:27.125152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.130019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.130490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.130961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.136105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4f82c-4f8f-45dc-9540-2e00cf134e82 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.142978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.143690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.143972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.144239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.145005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:27.145298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.146913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.152009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:27.153224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:27.156328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 160/310] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:27.157010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.167812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 151/311] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:27.168641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.170392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779270c-ca86-49db-a98f-cb1f22b1c438 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.176532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.177804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.178160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9caa3-02f1-468b-931b-2e571c341156 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.178278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.178583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] PATH_INFO: `/v3/users/0fd3b9f2a1ce41b8bef56e8eb89699d2` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.180554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] RBAC: Authorizing `identity:get_user(user_id=0fd3b9f2a1ce41b8bef56e8eb89699d2)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.182687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.182880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.183757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.184031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.184503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] PATH_INFO: `/v3/users/5c0faedfec6d46a3a5e3cf5c4db5bc94` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.184612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 161/312] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/users/0fd3b9f2a1ce41b8bef56e8eb89699d2 => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:27.190874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.200109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c0faedfec6d46a3a5e3cf5c4db5bc94)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.201108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d6ca-a22f-46ed-9b14-044d97e16a44 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.202251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.203953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 152/313] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/users/5c0faedfec6d46a3a5e3cf5c4db5bc94 => generated 293 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:27.204700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.205489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.206328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.206608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.206882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] PATH_INFO: `/v3/system/users/0fd3b9f2a1ce41b8bef56e8eb89699d2/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.208400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0fd3b9f2a1ce41b8bef56e8eb89699d2, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.209473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:27.209473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:02:27.209473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:02:27.210869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.214380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01a2a-b2db-403b-b646-71604616bee1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.218814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.219609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.219950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.220170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.221110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 162/314] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Dec 14 03:02:27 2021] PUT /identity/v3/system/users/0fd3b9f2a1ce41b8bef56e8eb89699d2/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:02:27.221311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.221933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.222952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.229685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 153/315] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:27.231212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:27.232873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c4949-991f-41d8-9c10-2db29acc6c93 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.237399 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.238331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.238610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.238888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.239795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] RBAC: Adding query filter params (role.id=9aeef3a1daa84b119d440f786f310585, user.id=5c0faedfec6d46a3a5e3cf5c4db5bc94, scope.system=all) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:27.240181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.242613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b633ab-331e-4e97-92b5-6c658690ad86 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.243659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2e2f-57d4-4e1a-a582-46ef86fcf1f7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:27.249675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:27.250637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:27.251034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 163/316] 10.222.0.43 () {56 vars in 1329 bytes} [Tue Dec 14 03:02:27 2021] GET /identity/v3/role_assignments?user.id=5c0faedfec6d46a3a5e3cf5c4db5bc94&scope.system=all&role.id=9aeef3a1daa84b119d440f786f310585 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:27.251246 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:27.251658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] PATH_INFO: `/v3/groups` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:27.252543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:27.253756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:27.253756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:27.253756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:27.255373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a2e4-1341-4a01-bbfd-ce5d372093b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:27.274186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 154/317] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Dec 14 03:02:27 2021] POST /identity/v3/groups => generated 229 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:29.615378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b31d4-10f7-47ea-8870-6ca10c657e8c None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.616431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b31d4-10f7-47ea-8870-6ca10c657e8c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.616504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b31d4-10f7-47ea-8870-6ca10c657e8c None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.616791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70d344-3b92-4394-904e-8fdd6ecf67e4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.617169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70d344-3b92-4394-904e-8fdd6ecf67e4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.617329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70d344-3b92-4394-904e-8fdd6ecf67e4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.618447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 164/318] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:29.619077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 155/319] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:29.624033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751756b-7116-4cc1-ab02-ac82017927ac None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.624326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751756b-7116-4cc1-ab02-ac82017927ac None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.624486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a647e2d-e87e-4845-8370-bd54b8192b39 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.624637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751756b-7116-4cc1-ab02-ac82017927ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.624725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a647e2d-e87e-4845-8370-bd54b8192b39 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.625001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a647e2d-e87e-4845-8370-bd54b8192b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.642646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a751756b-7116-4cc1-ab02-ac82017927ac None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:29.642856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8a647e2d-e87e-4845-8370-bd54b8192b39 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:29.643889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a751756b-7116-4cc1-ab02-ac82017927ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:29.644105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8a647e2d-e87e-4845-8370-bd54b8192b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:29.651563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 165/320] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:29.651780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 156/321] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:29.660497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1724f-5096-4c74-9b09-bfa7e7b5badc None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.660793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1724f-5096-4c74-9b09-bfa7e7b5badc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.661070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1724f-5096-4c74-9b09-bfa7e7b5badc None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.666776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 166/322] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:29.668322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.668617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.671293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.677570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1724f-5096-4c74-9b09-bfa7e7b5badc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.689520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:29.689829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1724f-5096-4c74-9b09-bfa7e7b5badc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.690738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:29.694767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.695557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.695839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.696133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.698773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 157/323] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:29.699629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.706224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:29.708397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347907be-3e0d-49ba-af34-cc553d777aed None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.712623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.713011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:29.713366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.713647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.713919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.719018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 167/324] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:29.720096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.729375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c58eae-8875-429f-93a9-b9fc160a31cb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.729501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:29.733536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.734152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.734431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.734702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.735480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:29.735782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.736150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:29.737307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 158/325] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:29.737418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.738315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.746690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 168/326] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:29.748176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1082-03e8-44be-a079-98236fcbdf88 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.748425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.753119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.753851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.754129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.754430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.755654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.757903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.758301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25853ff-aec0-4d01-986d-e0043577dc1a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.759487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 159/327] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:29.760213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.762543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.763187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.763469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.763744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.764478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:29.764775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.766327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.773584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051f4e-4e6c-4add-b860-98ee22d53d8a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.775246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 169/328] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:29.775909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.777904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.778698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.778979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.779281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] PATH_INFO: `/v3/users/5c0faedfec6d46a3a5e3cf5c4db5bc94` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.780593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] RBAC: Authorizing `identity:get_user(user_id=5c0faedfec6d46a3a5e3cf5c4db5bc94)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.782664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.789591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 160/329] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/users/5c0faedfec6d46a3a5e3cf5c4db5bc94 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:29.789708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523adb-b015-4aa5-94cd-83a321e2cee8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.789814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.793286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.793897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.794180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.794451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] PATH_INFO: `/v3/groups` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.794810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0b6e-0da7-46e1-a071-100712b29eca admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.795221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.796219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:29.796219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:02:29.796219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:02:29.797358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.799203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.799978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.800367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.800644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] PATH_INFO: `/v3/users/0fd3b9f2a1ce41b8bef56e8eb89699d2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.801807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] RBAC: Authorizing `identity:get_user(user_id=0fd3b9f2a1ce41b8bef56e8eb89699d2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.804480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.806261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 161/330] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/users/0fd3b9f2a1ce41b8bef56e8eb89699d2 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:29.807143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.827133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 170/331] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Dec 14 03:02:29 2021] POST /identity/v3/groups => generated 226 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:29.827133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:29.827439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf3c8a-d2df-453d-9976-6a38f471e857 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.827526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e3ef-f9a7-4172-98f6-35e48a44d667 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:29.827599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.827599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.827599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.827599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] PATH_INFO: `/v3/system/users/5c0faedfec6d46a3a5e3cf5c4db5bc94/roles/9aeef3a1daa84b119d440f786f310585` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.828640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:29.828944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c0faedfec6d46a3a5e3cf5c4db5bc94, role_id=9aeef3a1daa84b119d440f786f310585)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.829293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:29.829597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:29.829988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:29.830153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:29.830153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:29.830153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:29.830759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] RBAC: Adding query filter params (role.id=087c457f13d74023b2c0f38de56ab52c, user.id=0fd3b9f2a1ce41b8bef56e8eb89699d2, scope.system=all) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:29.830970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf1471-2fb9-483e-b2ea-2237e0cbbbfb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.831208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:29.832910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21023164-a74a-4403-b17b-9259c78d8130 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:29.842431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 162/332] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Dec 14 03:02:29 2021] PUT /identity/v3/system/users/5c0faedfec6d46a3a5e3cf5c4db5bc94/roles/9aeef3a1daa84b119d440f786f310585 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:29.861029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 171/333] 10.222.0.43 () {56 vars in 1329 bytes} [Tue Dec 14 03:02:29 2021] GET /identity/v3/role_assignments?user.id=0fd3b9f2a1ce41b8bef56e8eb89699d2&scope.system=all&role.id=087c457f13d74023b2c0f38de56ab52c => generated 510 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.087978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392753-7435-432e-85a2-2277b2ddab82 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.088486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392753-7435-432e-85a2-2277b2ddab82 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.088558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392753-7435-432e-85a2-2277b2ddab82 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.090472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 163/334] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:33.096277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.096716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.096809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.105365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa220a2-7f7b-4f15-af43-59562d3fb84d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.105654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa220a2-7f7b-4f15-af43-59562d3fb84d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.106873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa220a2-7f7b-4f15-af43-59562d3fb84d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.109170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 164/335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:33.115122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.115438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.115720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.119153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:33.120367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:33.138942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:33.140366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:33.141440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 172/336] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:33.148979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 165/337] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:33.191069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.191257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.202612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23589ce-77c6-4933-a6a9-aa9f164f3506 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.203886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11792717-f7e5-41e5-af7a-c768e06b433c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.210659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.211871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.212157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.212533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.216588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.217388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.217670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.217944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.224132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:33.232234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:33.234060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 166/338] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:33.240290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.248343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:33.251086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38183-8911-4c82-81df-cb5aebc3f288 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.255315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:33.257118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 173/339] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:33.260344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.261018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.261301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.261576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.262346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.262652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.264303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.264687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.276033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 167/340] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.281721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.281934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251b81-a0ff-43f7-8069-d7cf203267d0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.291878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3cba1-5d81-4854-875c-a4a4d2e04007 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.296556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.296797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.297223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.297390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.297536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.297698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.297839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.297975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.298517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.298819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.300476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e442f4-a402-4a18-8a19-e6069f4f253b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.306759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.308896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.319232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 174/341] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.319807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 168/342] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:33.323160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80124-e3d4-4cea-9b6e-b8a6a7bbffcb None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.323529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80124-e3d4-4cea-9b6e-b8a6a7bbffcb None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.323817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80124-e3d4-4cea-9b6e-b8a6a7bbffcb None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.325859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 175/343] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:33.326060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.326513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80124-e3d4-4cea-9b6e-b8a6a7bbffcb None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.335363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312eef-4ebb-4a5a-a655-688ac4f2e8b6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.341166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a76d02-6588-4c7e-85d9-b5f7f7dc749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.342185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a76d02-6588-4c7e-85d9-b5f7f7dc749a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.343075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a76d02-6588-4c7e-85d9-b5f7f7dc749a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.343357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a76d02-6588-4c7e-85d9-b5f7f7dc749a admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.344923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a76d02-6588-4c7e-85d9-b5f7f7dc749a admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.346949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a76d02-6588-4c7e-85d9-b5f7f7dc749a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.350981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 169/344] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:33.352250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.352541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.352981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.355701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80124-e3d4-4cea-9b6e-b8a6a7bbffcb None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.373427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.374083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.374369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.374650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.377844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:33.379093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:33.387622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 170/345] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:33.389067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.396137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.397964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.398427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ae488-1a49-446e-bad9-45c3e2075d5f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.403437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.404427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.404711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.404987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.409188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 176/346] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:33.414907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.415788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.416840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:33.416840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:33.416840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:33.418015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.419883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 171/347] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.424681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.435138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4055482-1449-41ca-9956-146cf78f1dd2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.442227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237cbc6-fd2d-4580-bc1e-f928ec005444 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.447313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.448175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.448451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.448722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.450380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.452461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.454696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 177/348] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:33.456374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.457795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.458579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.458859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.459185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.479770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f6b7-b116-4478-a4ff-7c31d519a342 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.481223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:33.488367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 14 03:02:33.489579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 172/349] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:33.494418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.495175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.495461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.495739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.496585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=d7f09e72d52d44edad5f503d25ed1815) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.496896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.498753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.501377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.512245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 178/350] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=a6a04d23aca344bc927a9b392991e951 => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.513092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.521579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dff7c2-5e2b-423c-b7fc-ac61632bb98d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.528608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac924-fea7-4065-a65b-3d76973c2fc7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.533618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.533618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.534012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.534192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.534192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.538762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.538762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.538762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.538762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.538762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.543295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.543366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.543429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.543812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 173/351] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.546095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.549237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 179/352] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.556250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.572732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f29f-10e2-4981-a725-a5effe5f19cc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.577822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7493-9616-4326-9e2c-daa5aa84d6f9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.584610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.585613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.586439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.587440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.588528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=d7f09e72d52d44edad5f503d25ed1815) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.589324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.590489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.595808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.598000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b63511-dffc-4161-bc88-a6bd4c6c82f3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.598665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.599179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] PATH_INFO: `/v3/users/5c0faedfec6d46a3a5e3cf5c4db5bc94` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.602983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] RBAC: Authorizing `identity:get_user(user_id=5c0faedfec6d46a3a5e3cf5c4db5bc94)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.605529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.608846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 180/353] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/users/5c0faedfec6d46a3a5e3cf5c4db5bc94 => generated 293 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.616625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.618685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 174/354] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=087c457f13d74023b2c0f38de56ab52c => generated 260 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:33.629424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759949e8-91f1-49e7-ae37-c61958a9fc5e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.639573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.640641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.641126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.641597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.642705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] RBAC: Adding query filter params (role.id=9aeef3a1daa84b119d440f786f310585, user.id=5c0faedfec6d46a3a5e3cf5c4db5bc94, scope.system=all) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.643303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.645518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01174bb-113d-4450-a379-8ab26a150fd0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.673956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 181/355] 10.222.0.43 () {56 vars in 1329 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/role_assignments?user.id=5c0faedfec6d46a3a5e3cf5c4db5bc94&scope.system=all&role.id=9aeef3a1daa84b119d440f786f310585 => generated 510 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.770637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02345ce6-af59-4fa0-9a9a-472300c08bd5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.771317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02345ce6-af59-4fa0-9a9a-472300c08bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.771843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02345ce6-af59-4fa0-9a9a-472300c08bd5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.774149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 175/356] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:33.781074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.781683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.782150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.808394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:33.809723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:33.821837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 182/357] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:33.859357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02345ce6-af59-4fa0-9a9a-472300c08bd5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.881525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02345ce6-af59-4fa0-9a9a-472300c08bd5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.891891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.893102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.893579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.894043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.906749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:33.914626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:33.916667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 176/358] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:33.923332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.934122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df2bab-20e4-4a6b-8720-d8d2823f44cc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.938847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.939566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.939849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.940123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:33.940966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:33.941280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:33.942919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:33.959057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 183/359] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:33.965557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:33.980973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c446-e675-408a-93c6-63baa56c6fa2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:33.992488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:33.993551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:33.994061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:33.994530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.008344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.010449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.025501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 177/360] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:34.032070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.048400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311c94c-b9ee-4615-8611-64b31187c4ef admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.057910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.058836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.059139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.059416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.062146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.064285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.066170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 184/361] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:34.073434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.083888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7712b4-3078-41e6-8f36-266fb153a958 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.090173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aee7a-430c-4fad-a394-fe5989add483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.091740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aee7a-430c-4fad-a394-fe5989add483 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.092217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aee7a-430c-4fad-a394-fe5989add483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.092727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aee7a-430c-4fad-a394-fe5989add483 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.094563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aee7a-430c-4fad-a394-fe5989add483 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.096660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aee7a-430c-4fad-a394-fe5989add483 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.098746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 178/362] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:34.104679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.117062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24866d43-9f8e-4209-bff9-83dd22d166af admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.123290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.123935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.124266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.124599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.125446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:34.125759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.127761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541c314-9187-4eef-b2ca-b23ec882bef1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.139528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 185/363] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=087c457f13d74023b2c0f38de56ab52c => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:34.183372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821a7d2-172f-4a25-ac71-624075124ca4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.184010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821a7d2-172f-4a25-ac71-624075124ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.184478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821a7d2-172f-4a25-ac71-624075124ca4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.186431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 179/364] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:34.192659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.192964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.193582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.219135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:34.220595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:34.230822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 186/365] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:34.269947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821a7d2-172f-4a25-ac71-624075124ca4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.286426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821a7d2-172f-4a25-ac71-624075124ca4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.293728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.294544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.294885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.295192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.316047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:34.323963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:34.325222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 180/366] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:34.331531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.345163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fefb1-80b5-4948-a416-bee33ca0ab4d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.355629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.356682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.357167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.357641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.358629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:34.359266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.361118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.375812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 187/367] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:34.382822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.396306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183688-711b-42e1-a9ff-64dcba23dd5a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.407001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.407677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.407953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.408221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.419511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.421278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.433262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 181/368] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:34.439508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.450715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4748-0068-490c-ada7-f22baba53d2f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.458367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.459818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.460100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.460371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.461583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.463704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.465583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 188/369] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:34.471264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.480773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0903-c596-4d29-abd5-dbe34ee26784 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.486263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a410c6-16c0-4b18-b22b-ff6dff738ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.487123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a410c6-16c0-4b18-b22b-ff6dff738ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.487404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a410c6-16c0-4b18-b22b-ff6dff738ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.487928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a410c6-16c0-4b18-b22b-ff6dff738ae9 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.491734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a410c6-16c0-4b18-b22b-ff6dff738ae9 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.493607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a410c6-16c0-4b18-b22b-ff6dff738ae9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.495485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 182/370] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:34.501700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:34.512100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e946-066a-4719-8acc-88f27ba3ca53 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:34.519028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:34.519693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:34.519972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:34.520242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:34.521075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:34.521378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:34.523264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d7a6-d495-4f50-8c0a-18012942e39f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:34.535474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 189/371] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:34 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=a6a04d23aca344bc927a9b392991e951 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:35.113980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b9748-96bb-40be-a8e4-f7fb2f1b1f37 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.114581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b9748-96bb-40be-a8e4-f7fb2f1b1f37 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.114581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b9748-96bb-40be-a8e4-f7fb2f1b1f37 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.116385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 183/372] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:35.122248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.122680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.122856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.144881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:35.146060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:35.157611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 190/373] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:35.192564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b9748-96bb-40be-a8e4-f7fb2f1b1f37 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:35.208980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b9748-96bb-40be-a8e4-f7fb2f1b1f37 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:35.216506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:35.217285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.217558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.217824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.235053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:35.242097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:35.247708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 184/374] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:35.253529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:35.263259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810657-0183-4c9f-84c2-4587eb6deb37 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:35.271197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:35.272500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.272778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.273047 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.273809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:35.274108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:35.275741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:35.290845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 191/375] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:35.297073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:35.306796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5ae7a-01cb-4964-ac90-00ceee75b6cc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:35.315081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:35.315718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.316001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.316270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.331250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:35.333034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:35.349813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 185/376] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:35.355622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:35.365761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb78c93-8549-4f69-a17b-ac7f254b2081 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:35.375117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:35.375964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.376242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.376513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] PATH_INFO: `/v3/projects/f5a40efb96444e869a317e4d0c361d64` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.377715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] RBAC: Authorizing `identity:get_project(project_id=f5a40efb96444e869a317e4d0c361d64)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:35.379532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:35.381737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 192/377] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:35 2021] GET /identity/v3/projects/f5a40efb96444e869a317e4d0c361d64 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:35.388345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:35.398093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc2e4-0f39-4817-b116-7d390c9c9605 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:35.407201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434858ea-7188-4fc0-8a80-b4f156370209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:35.408045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434858ea-7188-4fc0-8a80-b4f156370209 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.408319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434858ea-7188-4fc0-8a80-b4f156370209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.408587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434858ea-7188-4fc0-8a80-b4f156370209 admin admin] PATH_INFO: `/v3/groups/9af776b5cbc04330aacd1baadc2382c7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.413979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434858ea-7188-4fc0-8a80-b4f156370209 admin admin] RBAC: Authorizing `identity:get_group(group_id=9af776b5cbc04330aacd1baadc2382c7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:35.415891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434858ea-7188-4fc0-8a80-b4f156370209 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:35.417799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 186/378] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:35 2021] GET /identity/v3/groups/9af776b5cbc04330aacd1baadc2382c7 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:35.423808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:35.433564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e4d42-dcda-4913-8dcf-0f886c568319 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:35.440799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:35.441430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:35.441709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:35.441974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:35.442801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] RBAC: Adding query filter params (group.id=9af776b5cbc04330aacd1baadc2382c7, role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=f5a40efb96444e869a317e4d0c361d64) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:35.443131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:35.445522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281669f0-4b49-46d2-a965-e320b9c9a4e5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:35.455555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 193/379] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:35 2021] GET /identity/v3/role_assignments?group.id=9af776b5cbc04330aacd1baadc2382c7&scope.project.id=f5a40efb96444e869a317e4d0c361d64&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:36.848965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48537717-c79e-4fad-a0fe-c00ab4c4d89d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:36.850199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48537717-c79e-4fad-a0fe-c00ab4c4d89d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:36.850199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48537717-c79e-4fad-a0fe-c00ab4c4d89d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:36.852100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 187/380] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:36.858169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:36.858699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:36.858699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:36.880985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f40b-f768-423a-ad4d-348a360b6f6e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:36.881287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f40b-f768-423a-ad4d-348a360b6f6e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:36.881534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f40b-f768-423a-ad4d-348a360b6f6e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:36.883590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 188/381] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:36.889408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:36.889698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:36.889976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:36.891403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:36.892620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:36.910641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 194/382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:36.915779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:36.916970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:36.924749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 189/383] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:36.946767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:36.957969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d70cc-1a79-48c3-8166-9e340c43172c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:36.959677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:36.966929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:36.967754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:36.968032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:36.968361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:36.980308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f604a-3044-4333-9fbe-8094df9c9b22 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:36.984325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:36.985114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:36.985397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:36.985674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:36.988596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:37.001791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:37.003013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 195/384] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:37.010130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.011138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:37.017983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:37.019195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 190/385] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:37.026831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.031082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dd979-12ae-4b3e-a63d-690f5447dca3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.042264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.042924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.043235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.043507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.044274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:37.044575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.046179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.048853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fede8-0126-4710-9934-ea9b416d66e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.054799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.055488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.055768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.056042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.056804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:37.057106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.058688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.068457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 196/386] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.078059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.089154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 191/387] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.091573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc6fd-688f-42f2-8744-add5cb6a6bad admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.095208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.105927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.106401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.106677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.106941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.110470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e953a-2324-4ac8-bbc0-cfc13379df20 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.111612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.112939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:37.112939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:02:37.112939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:02:37.114122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.115954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 197/388] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.122379 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.128609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.129535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.129737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.130001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.132579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.134485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.137853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 192/389] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:37.144114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04fd6-5ddc-4c7d-9fd8-590c81e1bb6f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.149332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.150176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.150451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.150716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.152821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.160251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.162925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.164951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 198/390] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.168117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c900547-9e4a-4c83-bf03-c24f5fcfc2cc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.175178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.175981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.176168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.176329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.176566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.177816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.179924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.181923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 193/391] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.188003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da63742-c945-4053-8d59-1e0659a6731d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.195276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.197347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dab183-38ec-4a57-b723-3f3218c020f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.198219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dab183-38ec-4a57-b723-3f3218c020f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.198495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dab183-38ec-4a57-b723-3f3218c020f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.198762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dab183-38ec-4a57-b723-3f3218c020f8 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815/groups/8989f07ecd574a1195fc610d12af5460/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.201103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dab183-38ec-4a57-b723-3f3218c020f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f09e72d52d44edad5f503d25ed1815, group_id=8989f07ecd574a1195fc610d12af5460, role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.203752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dab183-38ec-4a57-b723-3f3218c020f8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.212427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a848a-53dc-41cf-8f03-24450b3f69d5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.225856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.226897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.227351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.227553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815/groups/8989f07ecd574a1195fc610d12af5460/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.229446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 199/392] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Dec 14 03:02:37 2021] PUT /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815/groups/8989f07ecd574a1195fc610d12af5460/roles/a6a04d23aca344bc927a9b392991e951 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:37.229769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f09e72d52d44edad5f503d25ed1815, group_id=8989f07ecd574a1195fc610d12af5460, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.230756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e1fe4-57ad-4fed-904d-a6a7ce0d6ffb None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.231055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e1fe4-57ad-4fed-904d-a6a7ce0d6ffb None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.231333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e1fe4-57ad-4fed-904d-a6a7ce0d6ffb None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.233209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 200/393] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:37.237272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.241239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.241523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.241797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.258653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 194/394] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Dec 14 03:02:37 2021] PUT /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815/groups/8989f07ecd574a1195fc610d12af5460/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:37.280418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:37.281652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:37.370097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 201/395] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:37.411013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.423294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef8763-c1bf-482b-a9b3-dbeeff3fd5e6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.435339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.436205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.436500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.436778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.453345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:37.461404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:37.462680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 195/396] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:37.469421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.483710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a36d88-bec8-412a-8188-e7358ff71c09 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.495954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.496645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.496927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.497196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.497974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:37.498274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.499956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.509900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 202/397] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.516429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.527747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c7c92-55cf-4552-a8a2-1418638f9470 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.539903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.540875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.541199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.541474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.542794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.544812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.546878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 196/398] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.552701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.569725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c9b01-4dd7-47d6-9b24-5fcbdee98405 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.580898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aece4-da2a-4da9-8f33-5c09db091e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.581762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aece4-da2a-4da9-8f33-5c09db091e06 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.582036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aece4-da2a-4da9-8f33-5c09db091e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.582300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aece4-da2a-4da9-8f33-5c09db091e06 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.588013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aece4-da2a-4da9-8f33-5c09db091e06 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.590080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aece4-da2a-4da9-8f33-5c09db091e06 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.592244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 203/399] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.598171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.600792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d524ab-0533-4daa-a0c3-da2b5e65f585 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.601077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d524ab-0533-4daa-a0c3-da2b5e65f585 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.601346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d524ab-0533-4daa-a0c3-da2b5e65f585 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.603395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 204/400] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:37.613698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.613698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.613698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.614033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb621c6-731f-4729-8ad0-9e771b504135 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.619115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.620124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.620408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.620684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/groups/8989f07ecd574a1195fc610d12af5460/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.622845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf4edfa0de424eac9c77cffbd654dd, group_id=8989f07ecd574a1195fc610d12af5460, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.625719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.633788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:37.635116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:37.644883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 197/401] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Dec 14 03:02:37 2021] PUT /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/groups/8989f07ecd574a1195fc610d12af5460/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:37.709396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 205/402] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:37.745457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.760298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c907c-2ebe-4ecb-b38c-4d1da12f60b5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.765204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.766038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.766315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.766588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.783801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:37.800100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:37.801377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 198/403] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:37.808050 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.821151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd129e-4a6b-482e-b51e-6de4973ae5ef None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.829967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.830639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.830915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.831207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.831973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:37.832272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.833918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.847853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 206/404] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.854592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.865132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba2bcc-d564-4f85-9e31-9571c425c2e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.877437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.878314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.878600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.878876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.880335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.882327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.889085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 199/405] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.890524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.901653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ab077-76c4-4d57-bca9-66a077e16e50 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.911528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6e186-e178-4fd5-ab8a-6b195324651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.912997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6e186-e178-4fd5-ab8a-6b195324651d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.913274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6e186-e178-4fd5-ab8a-6b195324651d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.913543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6e186-e178-4fd5-ab8a-6b195324651d admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.916010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6e186-e178-4fd5-ab8a-6b195324651d admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.918508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6e186-e178-4fd5-ab8a-6b195324651d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.920469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 207/406] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:37 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:37.926641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:37.937515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ee61-1bf7-4fb4-bc81-c32375f934d3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:37.947488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901338f-1c24-40ef-b227-efe220f00bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:37.948373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901338f-1c24-40ef-b227-efe220f00bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:37.948653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901338f-1c24-40ef-b227-efe220f00bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:37.948928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901338f-1c24-40ef-b227-efe220f00bf6 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/groups/8989f07ecd574a1195fc610d12af5460/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:37.951190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901338f-1c24-40ef-b227-efe220f00bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf4edfa0de424eac9c77cffbd654dd, group_id=8989f07ecd574a1195fc610d12af5460, role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:37.953792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901338f-1c24-40ef-b227-efe220f00bf6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:37.970502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 200/407] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Dec 14 03:02:37 2021] PUT /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd/groups/8989f07ecd574a1195fc610d12af5460/roles/a6a04d23aca344bc927a9b392991e951 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:38.875094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7399-c8e9-41eb-8782-85ca343ac4ae None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:38.875498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7399-c8e9-41eb-8782-85ca343ac4ae None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:38.875678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7399-c8e9-41eb-8782-85ca343ac4ae None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:38.877672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 208/408] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:38.884405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:38.885249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:38.885746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:38.904550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:38.906052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:38.975325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 201/409] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:38.995291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c7399-c8e9-41eb-8782-85ca343ac4ae None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:39.008647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c7399-c8e9-41eb-8782-85ca343ac4ae None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:39.016655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:39.017817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:39.018335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:39.018806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:39.030341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:39.038260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:39.045134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 209/410] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:39.046758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:39.060160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221f5e-4ec8-44a3-9d18-82dbf5353532 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:39.070774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:39.071473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:39.071758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:39.072041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:39.072809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:39.073116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:39.074727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:39.086869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 202/411] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:39.094378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:39.108018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d34d15-fd05-4b72-a505-9a5a70bb45be admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:39.117477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:39.118604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:39.119112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:39.119607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] PATH_INFO: `/v3/groups/9af776b5cbc04330aacd1baadc2382c7` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:39.123793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] RBAC: Authorizing `identity:get_group(group_id=9af776b5cbc04330aacd1baadc2382c7)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:39.125965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:39.127847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 210/412] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:39 2021] GET /identity/v3/groups/9af776b5cbc04330aacd1baadc2382c7 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:39.134413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:39.148152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b0cbc-a05d-40ed-b885-fc3626cf4141 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:39.154717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1279f-83c6-44c6-8f4e-1ed1d0fb9c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:39.155595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1279f-83c6-44c6-8f4e-1ed1d0fb9c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:39.155879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1279f-83c6-44c6-8f4e-1ed1d0fb9c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:39.156157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1279f-83c6-44c6-8f4e-1ed1d0fb9c29 admin admin] PATH_INFO: `/v3/projects/f5a40efb96444e869a317e4d0c361d64` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:39.159776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1279f-83c6-44c6-8f4e-1ed1d0fb9c29 admin admin] RBAC: Authorizing `identity:get_project(project_id=f5a40efb96444e869a317e4d0c361d64)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:39.161593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1279f-83c6-44c6-8f4e-1ed1d0fb9c29 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:39.164192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 203/413] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:39 2021] GET /identity/v3/projects/f5a40efb96444e869a317e4d0c361d64 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:39.170162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:39.181841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcfb9f-ae10-4b4f-af1c-253a10841c1f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:39.188601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003c44e-3d0f-4e3f-b875-4082722b385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:39.189738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003c44e-3d0f-4e3f-b875-4082722b385b admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:39.190222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003c44e-3d0f-4e3f-b875-4082722b385b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:39.190694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003c44e-3d0f-4e3f-b875-4082722b385b admin admin] PATH_INFO: `/v3/projects/f5a40efb96444e869a317e4d0c361d64/groups/9af776b5cbc04330aacd1baadc2382c7/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:39.196197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003c44e-3d0f-4e3f-b875-4082722b385b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a40efb96444e869a317e4d0c361d64, group_id=9af776b5cbc04330aacd1baadc2382c7, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:39.199126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003c44e-3d0f-4e3f-b875-4082722b385b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:39.228030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 211/414] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Dec 14 03:02:39 2021] PUT /identity/v3/projects/f5a40efb96444e869a317e4d0c361d64/groups/9af776b5cbc04330aacd1baadc2382c7/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:40.366268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6affae2-94ad-44d6-a40d-a902e74e5c66 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.366800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6affae2-94ad-44d6-a40d-a902e74e5c66 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.366800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6affae2-94ad-44d6-a40d-a902e74e5c66 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.368624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 204/415] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:40.375565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60876669-73e6-40ac-989c-8266fec07064 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.375995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60876669-73e6-40ac-989c-8266fec07064 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.376191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60876669-73e6-40ac-989c-8266fec07064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.401774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-60876669-73e6-40ac-989c-8266fec07064 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:40.402953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-60876669-73e6-40ac-989c-8266fec07064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:40.473874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 212/416] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:40.491815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc987-b4e1-4b01-8371-728bfc53fa4d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.492115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc987-b4e1-4b01-8371-728bfc53fa4d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.492378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc987-b4e1-4b01-8371-728bfc53fa4d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.494423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 205/417] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:40.509170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.509484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.509723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.516988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc987-b4e1-4b01-8371-728bfc53fa4d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.531246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:40.532441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:40.539988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc987-b4e1-4b01-8371-728bfc53fa4d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.549312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.550115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.550392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.550669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.551176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 213/418] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:40.574704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.578059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:40.586224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:40.589196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ae99d-e0d6-42d9-926a-e34fa66f98a9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.590091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 206/419] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:40.596775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.598391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.599248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.599565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.599842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.614983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806c337-eecf-4d05-835d-50779545a7f0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.621975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:40.628873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:40.630098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 214/420] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:40.635758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.636443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.636730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.636899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.637059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.637775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:40.638073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.639717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.651079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d337-63e3-4a50-ac9e-8985c09939c8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.657050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 207/421] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:40.662970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.664051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.664764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.665042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.665310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.666123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:40.666425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.668119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.678873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 215/422] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:40.687198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.688617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24533941-1523-41b4-abf5-3234379a3d5f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.697931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b1b3-8ec5-4e05-9039-a93e7b627e28 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.704626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.705797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.706078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.707738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.710260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.710903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.711532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.711815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.726292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.728323 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.731262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.733011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.745824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 216/423] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:40.747221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 208/424] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:40.753173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.753329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.763413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625b76-a3a8-4427-8781-b0eb52e34e88 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.771527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c77a2-234f-45c7-907d-2eecb1352a7d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.773821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.774672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.774950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.775277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.779793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.780117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.781094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.781396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.781670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.781832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.782908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.783846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 217/425] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:40.785004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.786770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 209/426] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:40.790244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.793993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.803660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c66e60-21c6-48da-8bd4-b851f98c4389 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.805765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8f5f-2cc4-472c-8aad-8270c7f4d8eb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.815776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.816544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.817626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.819241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.819721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.820184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.821241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.821721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.822555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.825203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.826059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.828175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.830030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 210/427] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:40.832119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 218/428] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:40.836424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.839837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:40.854908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d06908-3cb7-4b3e-98db-ad82d4059efd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.856576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505a7a-66b8-4362-afbb-6d591f58c9a6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:40.863196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.863844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.864127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.864401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.865776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=d7f09e72d52d44edad5f503d25ed1815) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:40.866089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.867975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d2684-0cbb-4c2d-8629-e09eb18b2e83 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.871300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:40.871937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:40.872269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:40.872490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:40.873332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=d7f09e72d52d44edad5f503d25ed1815) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:40.873639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:40.875530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1903a-fc13-4b8e-a6f3-0735d2ccb302 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:40.885947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 211/429] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=087c457f13d74023b2c0f38de56ab52c => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:40.886243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 219/430] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:40 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=d7f09e72d52d44edad5f503d25ed1815&role.id=a6a04d23aca344bc927a9b392991e951 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:41.043686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd930f2-9a34-4cc3-b761-425095786379 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.044000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd930f2-9a34-4cc3-b761-425095786379 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.044249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd930f2-9a34-4cc3-b761-425095786379 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.046374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 212/431] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:41.052573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.054102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.054574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.075088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551211e-91bd-456f-aa6e-1f0e2a792cd8 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.075088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551211e-91bd-456f-aa6e-1f0e2a792cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.075088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551211e-91bd-456f-aa6e-1f0e2a792cd8 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.075088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 213/432] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:41.081026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.081357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.081583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.082192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:41.083715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:41.104383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 220/433] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:41.117005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:41.118605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:41.127524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 214/434] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:41.147005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.157249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e338f6-fc6d-4eab-9a9b-584385c4e578 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.157439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.167798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456c27-462e-40e5-b0a8-bbb16a00cd35 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.168845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.169953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.170432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.170864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.172770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.173664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.173771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.174005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.188254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:41.192471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:41.195595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 14 03:02:41.198696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 221/435] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:41.200553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:41.202745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 215/436] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:41.208147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.209915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.219822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819a85-d9da-4110-89f5-f022aceab8cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.220372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8508a49-2f0b-4c05-b141-9fe13c46d1c2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.230397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.231121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.231372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.231642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.232409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:41.232593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.232699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.233265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.233543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.233819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.234303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.234583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:41.234896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.237216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.248633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 222/437] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:41.251469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 216/438] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:41.258574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.259963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.269624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220b1f-7225-4e06-912a-015cea504cb3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.272242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5697-e325-4722-a2ff-4afcf3b3d662 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.275748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.276772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.277058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.277330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.284675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.285329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.285609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.285932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.287648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.289416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.296105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.297995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.300718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 223/439] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:41.309216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.310572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 217/440] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:41.318206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79f69d-41e1-4e7d-b4a2-94fa96a6b33d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.319302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.325539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.326386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.326670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.326949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.328160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.329187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f65d-ed5e-492f-9771-412d283da005 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.330207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.331906 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 224/441] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:41.337877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.338809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.339934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.340454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.340899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] PATH_INFO: `/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.342439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0cf4edfa0de424eac9c77cffbd654dd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.345900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.348016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 218/442] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/projects/f0cf4edfa0de424eac9c77cffbd654dd => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:41.351251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daff30-766b-4292-9923-61c766a8d55a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.354978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.360608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.361458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.361741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.362019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.363532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.366043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.367248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3a7cb-5bbe-4012-87f1-d338ac7089e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.367957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 225/443] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:41.374188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.374508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.375485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.375767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.376040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] PATH_INFO: `/v3/groups/8989f07ecd574a1195fc610d12af5460` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.377230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] RBAC: Authorizing `identity:get_group(group_id=8989f07ecd574a1195fc610d12af5460)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.379473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.382080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 219/444] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/groups/8989f07ecd574a1195fc610d12af5460 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:41.385454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04e2c-a0b4-4d4f-9418-2b504a609db1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.388112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:41.394865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.396071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.396589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.397078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.397831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab767b-c32f-4e2d-9f3f-ff7f8586c90a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:41.398325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:41.398958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.401070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940dcc-8be8-4462-9684-5fc508807921 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.402338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:41.402964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:41.403282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:41.403555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:41.404602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] RBAC: Adding query filter params (group.id=8989f07ecd574a1195fc610d12af5460, role.id=087c457f13d74023b2c0f38de56ab52c, scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:41.404911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:41.407265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f73a5b-a326-47c7-a82f-8939b3475fcc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:41.409916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 226/445] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=a6a04d23aca344bc927a9b392991e951 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:41.417442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 220/446] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:41 2021] GET /identity/v3/role_assignments?group.id=8989f07ecd574a1195fc610d12af5460&scope.project.id=f0cf4edfa0de424eac9c77cffbd654dd&role.id=087c457f13d74023b2c0f38de56ab52c => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:42.492983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9fe92-d593-4d2c-8d3e-a55ee6634ed8 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.493498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9fe92-d593-4d2c-8d3e-a55ee6634ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.493581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9fe92-d593-4d2c-8d3e-a55ee6634ed8 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.495339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 227/447] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:42.500784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.501185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.501335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.518453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:42.519663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:42.527457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 221/448] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:42.551029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9fe92-d593-4d2c-8d3e-a55ee6634ed8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:42.562681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9fe92-d593-4d2c-8d3e-a55ee6634ed8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:42.566862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:42.567640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.567924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.568203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.578407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:42.585667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:02:42.586755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 228/449] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:42.592419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:42.601404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4360ae-0b19-4917-a6d0-d22837c0658a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:42.605657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:42.606289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.606569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.606842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.607616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:42.607922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:42.609492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:42.617622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 222/450] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:42.622872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:42.633018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4755e1-0ca6-4faf-a964-513b20f6bd6e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:42.637274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:42.637860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.638140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.638413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.645923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:42.648852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:42.657366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 229/451] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:42.663020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:42.672495 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f99d-1ddc-4233-9445-8a50e2352083 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:42.676873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:42.677730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.678016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.678293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] PATH_INFO: `/v3/projects/f5a40efb96444e869a317e4d0c361d64` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.679526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] RBAC: Authorizing `identity:get_project(project_id=f5a40efb96444e869a317e4d0c361d64)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:42.681288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:42.682908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 223/452] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:02:42 2021] GET /identity/v3/projects/f5a40efb96444e869a317e4d0c361d64 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:42.688288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:42.697402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d0148-ec6a-44ac-ba82-1012759df0c4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:42.701935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b37ad-22f7-455e-bb80-5ee9628e5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:42.702749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b37ad-22f7-455e-bb80-5ee9628e5988 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.703022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b37ad-22f7-455e-bb80-5ee9628e5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.703316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b37ad-22f7-455e-bb80-5ee9628e5988 admin admin] PATH_INFO: `/v3/groups/9af776b5cbc04330aacd1baadc2382c7` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.704473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b37ad-22f7-455e-bb80-5ee9628e5988 admin admin] RBAC: Authorizing `identity:get_group(group_id=9af776b5cbc04330aacd1baadc2382c7)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:42.706327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b37ad-22f7-455e-bb80-5ee9628e5988 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:42.707897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 230/453] 10.222.0.43 () {56 vars in 1201 bytes} [Tue Dec 14 03:02:42 2021] GET /identity/v3/groups/9af776b5cbc04330aacd1baadc2382c7 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:42.714386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:42.723741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9fe4e-d021-4e49-92aa-cc4796089784 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:42.728976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:42.729595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:42.729875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:42.730147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:42.730969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] RBAC: Adding query filter params (group.id=9af776b5cbc04330aacd1baadc2382c7, role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=f5a40efb96444e869a317e4d0c361d64) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:42.731308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:42.733219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b88c20-6ff3-4db2-854c-95027225b851 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:42.745028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 224/454] 10.222.0.43 () {56 vars in 1397 bytes} [Tue Dec 14 03:02:42 2021] GET /identity/v3/role_assignments?group.id=9af776b5cbc04330aacd1baadc2382c7&scope.project.id=f5a40efb96444e869a317e4d0c361d64&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:45.533810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f7f2f-06d7-49f3-bf08-b922a301430b None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.534329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f7f2f-06d7-49f3-bf08-b922a301430b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.534329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f7f2f-06d7-49f3-bf08-b922a301430b None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.536421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 231/455] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:45.542971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.543833 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.544316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.568015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:45.570130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:45.578283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 225/456] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:45.610946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f7f2f-06d7-49f3-bf08-b922a301430b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:45.628894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f7f2f-06d7-49f3-bf08-b922a301430b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:45.636522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:45.637301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.637578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.637850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.648919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:45.650752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:45.677412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:45.679617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 232/457] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:45.685708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:45.700468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf064033-c898-4eab-bdd8-87b9bb0de712 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:45.711980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:45.712899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.713319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.713742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.714615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:45.715097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:45.716266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:45.716266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:45.716266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:45.717407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f5321-88bc-4434-a198-6a1005f23b4c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:45.745231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 226/458] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:45.751234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:45.764259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f15586-480f-4e62-9987-fede093fca2a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:45.775259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38419402-439e-4871-9b1b-23e0a762928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:45.775923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419402-439e-4871-9b1b-23e0a762928e admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.776207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419402-439e-4871-9b1b-23e0a762928e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.776483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419402-439e-4871-9b1b-23e0a762928e admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.777204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38419402-439e-4871-9b1b-23e0a762928e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:45.779146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38419402-439e-4871-9b1b-23e0a762928e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:45.814000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 233/459] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:45 2021] POST /identity/v3/users => generated 246 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:45.937066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8e5e-0858-4629-8f6b-307043d2e93c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.937737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8e5e-0858-4629-8f6b-307043d2e93c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.938244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8e5e-0858-4629-8f6b-307043d2e93c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.940585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 227/460] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:45.947598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf2a4-c273-4614-940f-05e1433086b9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.947883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf2a4-c273-4614-940f-05e1433086b9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.948325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf2a4-c273-4614-940f-05e1433086b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.972552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6fadf2a4-c273-4614-940f-05e1433086b9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:45.974031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6fadf2a4-c273-4614-940f-05e1433086b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:45.985723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 234/461] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:45.993123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4a63-d59c-4a2b-88c8-7305402c5116 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:45.993695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4a63-d59c-4a2b-88c8-7305402c5116 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:45.994193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4a63-d59c-4a2b-88c8-7305402c5116 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:45.996482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 228/462] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:46.002138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.002428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.002703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.017999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4a63-d59c-4a2b-88c8-7305402c5116 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.023265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:46.024580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:46.040966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4a63-d59c-4a2b-88c8-7305402c5116 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.042286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 235/463] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:46.052328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.054020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.054503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.055032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.071446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.072920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.076471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.083089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d029-2027-40bd-a01a-624e891c07bd None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.096416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.097659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.099611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.101181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.110752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:46.113009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 229/464] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:46.120271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.123480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.125700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.130322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3739bfe-c1ff-42fa-93e8-56a05d1eb485 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.136540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.137268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.137548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.137937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.138713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:46.139098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.147072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.155757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 230/465] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:46.159324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:46.163201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.164957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 236/466] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:46.171312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00c64-45b0-4cca-9814-0302202a1659 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.172265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.175927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.176577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.176853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.177124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.178390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.180597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.184793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84cab0-b0d9-41ff-9038-f9ada54efe61 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.190561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.191395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.191804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.192198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.193817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:46.194788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.196423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c2d21-ceeb-4ffd-a8f8-94e2cb560d1f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.206532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 231/467] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:46 2021] POST /identity/v3/users => generated 248 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:46.213833 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 237/468] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:46.220031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.236685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23343-39e9-4b45-8f5c-9b136e5aa9ed admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.242580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dde90-0178-4197-b159-0120df7f555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.243624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dde90-0178-4197-b159-0120df7f555e admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.244049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dde90-0178-4197-b159-0120df7f555e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.244462 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dde90-0178-4197-b159-0120df7f555e admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.245335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dde90-0178-4197-b159-0120df7f555e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.247489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dde90-0178-4197-b159-0120df7f555e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.273780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 232/469] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:46 2021] POST /identity/v3/users => generated 248 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:46.385491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc929-5fe4-4566-a371-094021bebb57 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.385858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc929-5fe4-4566-a371-094021bebb57 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.386236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc929-5fe4-4566-a371-094021bebb57 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.388216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 238/470] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:46.394941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd235-671b-4102-8746-71189e7b835c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.395488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd235-671b-4102-8746-71189e7b835c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.395908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd235-671b-4102-8746-71189e7b835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.419555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-348bd235-671b-4102-8746-71189e7b835c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:46.421028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-348bd235-671b-4102-8746-71189e7b835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:46.434041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 233/471] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:46.464019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc929-5fe4-4566-a371-094021bebb57 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.486588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc929-5fe4-4566-a371-094021bebb57 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.494850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.495666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.496012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.496288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.511494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.513792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.532216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:46.534229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 239/472] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:46.540694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd235-671b-4102-8746-71189e7b835c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.549909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd235-671b-4102-8746-71189e7b835c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.561023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.561699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.561970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.562240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.562981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:46.563327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.564927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a78ba8-e559-4740-9084-06d72a3b4920 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.578335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 234/473] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:46.584069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:46.596248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb324c-1ec9-49c8-bb44-344c00abc496 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:46.606720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f9aa-b878-4802-b50a-edc988d0c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:46.607432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f9aa-b878-4802-b50a-edc988d0c26b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:46.607717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f9aa-b878-4802-b50a-edc988d0c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:46.607994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f9aa-b878-4802-b50a-edc988d0c26b admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:46.608749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f9aa-b878-4802-b50a-edc988d0c26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:46.610738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f9aa-b878-4802-b50a-edc988d0c26b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:46.646606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 240/474] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:46 2021] POST /identity/v3/users => generated 249 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:02:47.073365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488faeb0-ec49-42e8-a34b-2dd87baf9eee None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:47.073737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488faeb0-ec49-42e8-a34b-2dd87baf9eee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:47.073911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488faeb0-ec49-42e8-a34b-2dd87baf9eee None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:47.075959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 235/475] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:47.082407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:47.082910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:47.083412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:47.103710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:47.105231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:47.121438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 241/476] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:47.146062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488faeb0-ec49-42e8-a34b-2dd87baf9eee None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:47.158828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488faeb0-ec49-42e8-a34b-2dd87baf9eee None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:47.164700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:47.165938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:47.166590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:47.167294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:47.168660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:47.170464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:47.180555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.sql.core [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 14 03:02:47.180555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 14 03:02:47.180555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [parameters: {'id': '27bfd00fc2cc4fa694844cfb2117bfcd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 14 03:02:47.180555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 14 03:02:47.195437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 14 03:02:47.197329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 236/477] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:02:47 2021] POST /identity/v3/roles => generated 144 bytes in 52 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:47.203845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:47.214002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f5a6-3f4b-4c56-af13-485743543413 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:47.219117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c6ea6-4b75-43e3-a53c-8cec778a4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:47.220128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c6ea6-4b75-43e3-a53c-8cec778a4c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:47.220592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c6ea6-4b75-43e3-a53c-8cec778a4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:47.221003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c6ea6-4b75-43e3-a53c-8cec778a4c40 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:47.232783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c6ea6-4b75-43e3-a53c-8cec778a4c40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:47.241168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-978c6ea6-4b75-43e3-a53c-8cec778a4c40 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 14 03:02:47.242842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 242/478] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:02:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:47.249394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:47.260876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd5ba3-1942-4d8f-9d10-8f3efc7f6876 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:47.265799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:47.266605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:47.267126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:47.267542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:47.268657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:47.269168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:47.270991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b157d5-7c87-4c2e-b7f0-95c86a36ac99 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:47.280203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 237/479] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:48.908694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724548-16df-4230-b48d-23e97887edd4 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:48.909220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724548-16df-4230-b48d-23e97887edd4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:48.909220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724548-16df-4230-b48d-23e97887edd4 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:48.911312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 243/480] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:48.931490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:48.932334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:48.932784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:48.955085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:48.956502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:48.969048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 238/481] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:49.007617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724548-16df-4230-b48d-23e97887edd4 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.024741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724548-16df-4230-b48d-23e97887edd4 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.033749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.034922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.035431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.035924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.054354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:49.061518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:49.063252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 244/482] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.069332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.084686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d15e-b447-44ea-8b11-26f87811069a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.089624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.090279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.090558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.090826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.091606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.091907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.093483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.109455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 239/483] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.115456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.127865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e165339-3729-4b2d-ab7c-8ace949d3781 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.135078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.136088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.136568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.137033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.155244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.157380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.179722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:49.181219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 245/484] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.187383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.200010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f6803-6732-4316-9169-4e7da251d9ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.210524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.211198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.211477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.211748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.212474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.212779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.214350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.233476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 240/485] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.239558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.251973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5aba6-7e4b-42bd-8808-4bc2e78db34e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.263138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.264171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.264670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.265137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.280183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.282513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.300892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-357a2138-0d21-4f00-9963-328e4efd8806 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:02:49.302743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 246/486] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.308497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.311737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31f901-fcd7-4157-ac4b-bb8c45155f04 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.312245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31f901-fcd7-4157-ac4b-bb8c45155f04 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.312716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31f901-fcd7-4157-ac4b-bb8c45155f04 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.314915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 247/487] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:49.321603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.322129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.322619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.325490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb962e4-41d6-406f-a132-940574e81f30 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.337826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.338804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.339402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.339872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.340911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.341410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.342620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:49.342620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:49.342620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:49.344128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.360324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:49.361586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:49.377942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 248/488] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:49.398354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 241/489] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.404041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.415368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.416557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cc23-2c31-4cf8-aaa7-2feb900b51ed None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.425703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f56f-fbb3-438e-9d2e-a258cd4b1c9a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.429030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f150e8-9b11-49fe-8ed1-ff5dd684a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.429684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f150e8-9b11-49fe-8ed1-ff5dd684a6df admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.430015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f150e8-9b11-49fe-8ed1-ff5dd684a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.430278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f150e8-9b11-49fe-8ed1-ff5dd684a6df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.431406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.432419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.432911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.433380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.442279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f150e8-9b11-49fe-8ed1-ff5dd684a6df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.445836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f150e8-9b11-49fe-8ed1-ff5dd684a6df admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.445988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:49.453334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:49.455120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 249/491] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:49.455227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 242/491] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:49.462125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e264a-f1e8-4702-b974-25154f58edf3 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.462437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e264a-f1e8-4702-b974-25154f58edf3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.462723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e264a-f1e8-4702-b974-25154f58edf3 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.463444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.464678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 250/492] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:49 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:49.465389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e264a-f1e8-4702-b974-25154f58edf3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.475379 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c005-5ee3-4603-9ca0-dded7ebc5a8f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.480540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.481463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.481941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.482340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e264a-f1e8-4702-b974-25154f58edf3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.482714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.483768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.484355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.486193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0949f-806c-45e6-912a-c7e52c33d608 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.486717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.487521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.488057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.488332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.497919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 243/493] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:49.504022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.504157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.504645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.507304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.509448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.525838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:49.527371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:49.529587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:49.531322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 251/494] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.536932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.541672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 244/495] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:49.543075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.556691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae7ce6-867c-4b8e-b330-68d0eb173af3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.564433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8d59-874c-4fb3-a966-4dfe9084ce72 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.566116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.567787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.569023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.569396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.579200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.579967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.580345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.580716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.581539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.581942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.584283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.588285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.590336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.596300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 245/496] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.597270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.606677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f0ce-54a9-4c99-9365-b3249d92759d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.611448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.612204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:49.612463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.613139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.613506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.614628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 252/497] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.615748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.624959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:49.626747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d29ee-9069-4af7-8524-3220f416b4a9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.631856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.632790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.633056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:49.633385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.633797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.634553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 246/498] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.635482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.642189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.644768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.645511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4148ac1-3fe8-4c5e-9af0-28bf47059241 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.651194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.651993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.652377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.652800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.653711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.654138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.656028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.662256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:49.663881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 253/499] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.664752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.673822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 247/500] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.674836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.675413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726052f-ceb5-449f-b346-3a231a2ab69c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.679876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.680696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.681023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.681403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.682260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.682666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.684413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.688180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c097-4ba0-4b7e-b882-a39aa413583b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.693964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 254/501] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.694460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.695049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.695649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.696213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.696683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.697662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.698128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.699657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:49.699657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:02:49.699657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:02:49.701322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.705137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9f86a-e5d0-407c-abc7-037cbc2eb8a4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.710383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.711384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.711782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.712155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.721329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.723532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.729280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 248/502] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.730539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.738000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 14 03:02:49.739542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 255/503] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.741189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.750082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636617-48eb-4fc4-a4da-2b5bfdf68965 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.751363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedfad6-cdba-42b8-b773-adcabb5c65b0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.755028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.756531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.756659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.757041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.757192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.757501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.757608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.757825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.758708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=b1d2810610e748859ea9ff10d45190b1) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.759011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.761526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.771151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 256/504] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/role_assignments?user.id=b1d2810610e748859ea9ff10d45190b1&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.772150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.778308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.780522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.796707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaea9c-3df4-48fb-ab7b-c3932358dd25 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.806503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.807408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.808796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.809149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.810063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.810375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.811643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:49.811643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:02:49.811643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:02:49.812922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.813383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1bb2fb2b-846e-4184-8750-5c8f0eb08d4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:49.814922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 249/505] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.816172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c557f49-663e-4b6b-89e9-a64c77d6173d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.816564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c557f49-663e-4b6b-89e9-a64c77d6173d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.816954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c557f49-663e-4b6b-89e9-a64c77d6173d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.819713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 250/506] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:49.826028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.826551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.826954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.846663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:49.848045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:49.860333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 257/507] 10.222.0.43 () {56 vars in 1158 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.861544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.863305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 251/508] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:49.867160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.879678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621afb7-f027-4a53-a733-8553603f580e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.885292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51de30-8132-4da1-8c8a-2634b1b8402e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.891414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.892097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.892532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.892815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.893662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:49.894006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.894944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.895792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.895904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.896355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.896769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.905532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.907339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.909113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 258/509] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:49.910655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.923433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 252/510] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:49.924172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed770e76-335d-4b09-a8af-6b386038ec8e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.924355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.930155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.932010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.932731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.933160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.934974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741d64-eb29-42d0-9857-6914dc7271b7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.939613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.940410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.940693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.940968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.948899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:49.949296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:49.951397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:49.958011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:49.965433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 259/511] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.965433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.973731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 14 03:02:49.976067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 253/512] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:49.976864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:49.982376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ae10-9bc1-43c7-b9a8-6cbbe1ba48d8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.988122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.989930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.990435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.990919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:49.993407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0086c0-1fd3-4905-a700-115606f6bdaa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:49.998082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:49.998748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:49.999028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:49.999340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.000113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.000417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.002039 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.005327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.007589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.010957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 254/513] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.016032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.023682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3260d7-1aa1-4064-94e8-b97002758cc1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.030719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.031723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.032228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.032764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.032866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:50.033931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.034452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.037325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.039177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 260/514] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.040341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.058729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0320880-a35b-4ec2-a1ad-2bc9c4a2ef23 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.060610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 255/515] 10.222.0.43 () {56 vars in 1158 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.061758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.070145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.071135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.071425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.071706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.073866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb08e-ac0b-43e2-9ce1-3b54d780b433 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.079319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.080695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.081177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.082026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.083287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.084226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.084565 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.086194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.086570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.100309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 256/516] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.101393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.110833 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b0ce-7dad-43e4-8b93-a172e20c6d63 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.111682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:50.115110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 261/517] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.116164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.121264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.122214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.122691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.123220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.128593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac246da7-fc47-4c75-a9db-5ad946d1585b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.133841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.134558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.135351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.135640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.135916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.137130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.143713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.145983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.150132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 257/518] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:50.151222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.161081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba6a98-fb5c-428a-8f92-64709807fef1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.165867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.166520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:50.166976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.167557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.167773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 262/519] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.168226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.169144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.169673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.171543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.173700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.185996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aae77-36d2-4038-9dc7-76de88f538ef admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.186273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 258/520] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.187299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.197065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.197845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.198129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.198409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.198775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab864-def3-4342-90ea-2a1b0d69bd82 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.204023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.205024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.205503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.206401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.207812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.208358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.210162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.211595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.212131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.225678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 259/521] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.226869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.236471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a668a0d-2865-44b0-bc5f-a4c139a277f7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.237295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:50.239202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 263/522] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.241254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.247156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.250895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.251414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.251902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.260747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355fa9c-d481-4f24-b632-f8a5f36c2d6a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.261815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.264060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.265772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.266572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.266873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.267688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.268529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=647e47606fc9438cb580f58fe7daae4f) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.268894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.270855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.279921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 14 03:02:50.281661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 260/524] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.281766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 264/524] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/role_assignments?user.id=647e47606fc9438cb580f58fe7daae4f&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.286921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.288014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.298991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8b4b-987f-498e-b536-ca45d0df08e6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.303557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6b51-0434-41cb-8075-53e1e8b51fe1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.304309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.305192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.305718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.306212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.307307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.307831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.309895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.312552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.314162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.314455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.314732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.315500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.315811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.317417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.348821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 265/525] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.359244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.360860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 261/526] 10.222.0.43 () {56 vars in 1160 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.377297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef55ed1-20d5-41f2-a8ee-7979a520f33c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.379882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.391491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfa502-268a-41a5-bcbe-e9cfd61659f0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.395590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.398676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.399228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.400216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.402721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.404783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.406967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.407547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.417458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.422258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.425168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.428707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.451641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 262/527] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:50.452866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-38fb726c-61a7-4bab-99f9-10d06d409187 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:50.454579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 266/528] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.458322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.462218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019f9b-230b-461e-90b1-bbce5a2c1c19 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.462731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019f9b-230b-461e-90b1-bbce5a2c1c19 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.463259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019f9b-230b-461e-90b1-bbce5a2c1c19 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.465236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 267/529] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:50.466167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019f9b-230b-461e-90b1-bbce5a2c1c19 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.472748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac5db4-f573-45d5-b6b6-71c8c21b0c48 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.477953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.478741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.479023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.479334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.481313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019f9b-230b-461e-90b1-bbce5a2c1c19 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.486354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.487489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.488171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.488580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.489529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.490614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.491872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:02:50.491872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:02:50.491872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:02:50.492389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.493577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.494453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.512861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-395939c9-0855-40d6-92a4-ea4e2c9139fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:50.514560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 263/530] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.520001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.520001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.520001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.520866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 268/531] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.522444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.532515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965afab-62a2-44c0-9fe1-ce595b560310 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.536474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:50.538082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.538602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:50.539138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.539573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.539978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.540847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.541303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.543074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.549249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 264/532] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:50.551955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.558753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 269/533] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.565707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.567278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34368-3e29-4cc8-ba2a-51d681f9c376 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.575539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c683-09c1-420a-a065-73fe37815755 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.579199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.579850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.580136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.580425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.581253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=1a9f0d0a342649658a174da2d495fe8d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.581562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.583448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.584924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.585918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.586330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.586734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.590729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 265/534] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/role_assignments?user.id=1a9f0d0a342649658a174da2d495fe8d&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.591544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.594377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.596416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.607715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a93f1-ebb5-435a-992e-efb302dbb046 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.611774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:50.613627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 270/535] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.614327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.615432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.615923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.616417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.619617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.630757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.634152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.635483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db285f-be03-4507-9145-37fd85831f18 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.640777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.641438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.641716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.641986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.642793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.643141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.646599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.667155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:50.674524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 266/536] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:50.676815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.679657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 271/537] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:50.685772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.704332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952e691-0d68-4e42-8d9e-8354a1ee9d8e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.705248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bca6f7-c9ff-460d-b589-bfc3ad21f4b1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.713772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.716180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.717045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.717552 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.718077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.719720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.719984 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.720515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.721014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.721525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.724963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=5f08db48e9814f7db34ffcf7d581fc12) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:50.725415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03724dd4-8f48-4762-891e-f2a3263f4275 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.727663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.731530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.746444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 272/538] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/role_assignments?user.id=5f08db48e9814f7db34ffcf7d581fc12&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.750436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 267/539] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:50.756371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:50.770616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac65933-cdd8-459c-a28a-b0e5da66adcd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:50.782058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c97e-4065-493e-a7a8-10a0a8c289ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:50.783202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c97e-4065-493e-a7a8-10a0a8c289ca admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:50.783715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c97e-4065-493e-a7a8-10a0a8c289ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:50.784248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c97e-4065-493e-a7a8-10a0a8c289ca admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:50.785218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c97e-4065-493e-a7a8-10a0a8c289ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:50.788090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c97e-4065-493e-a7a8-10a0a8c289ca admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:50.826749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 273/540] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:02:50 2021] POST /identity/v3/users => generated 247 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:02:52.440978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43bd71-23e3-40ae-8f08-76f10babff82 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.441493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43bd71-23e3-40ae-8f08-76f10babff82 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.441567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43bd71-23e3-40ae-8f08-76f10babff82 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.443482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 268/541] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:52.449536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.449964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.450167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.472334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:52.473524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:52.484032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 274/542] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:52.520049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43bd71-23e3-40ae-8f08-76f10babff82 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.535461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43bd71-23e3-40ae-8f08-76f10babff82 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.545056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.545871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.546155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.546430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.558525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:52.570148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:52.571697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 269/543] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:52.577780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.587836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90a34-e3e0-46c0-8638-f2bef0ea2a39 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.597911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.598706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.598994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.599320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.600083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:52.600387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.601989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.610680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 275/544] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:52.617101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.627615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b038-f9d5-4bff-b46f-937eb87dcd17 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.635153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.635925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.636211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.636488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.647891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.649724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.681416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:52.682932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 270/545] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:52.688795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.699381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e75f8-1688-41a9-8fa0-ba9ddfce8ef4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.711077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.711734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.712013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.712287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.713031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:52.713337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.714960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.732921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 276/546] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:52.739502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.750418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99200444-f8de-4919-9d06-ba6a67576433 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.759936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.760744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.761027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.761307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.769279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.771400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.794662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:02:52.796233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 271/547] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:52.802811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.812793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1476db-b79e-40de-9be5-b30048e3e9f6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.821978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.822628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.822911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.823217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.824064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:52.824369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.826229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.844228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 277/548] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:52.850165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.860100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe549-981f-4c8e-9f5d-a4226c889dd4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.872192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.872984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.873265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.873543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.884595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.886440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.908164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:52.909362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 272/549] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:52.916099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.925980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116c226-446b-49dc-840e-6b56b80c376c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.932616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.933243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.933697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.934196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.935537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:52.936295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.939371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:52.957924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 278/550] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:52.963981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:52.973838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78326-c994-4248-a6e7-85226dbccd0e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:52.983129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:52.983922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:52.984496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:52.984776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:52.992986 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:52.994944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.012634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:53.013823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 273/551] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.020089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.029901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278cfc2-b510-478a-b08b-f6d9903c1003 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.037968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.038607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.038892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.039195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.039989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.040298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.042138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9074dbb-da72-4e0e-9743-58caf42c552b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.055209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 279/552] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:53.061489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.072649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50147fe0-860c-4928-9689-906c61507df0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.082065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15f7b4-c1bd-4830-bb48-a3d868dc70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.082932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15f7b4-c1bd-4830-bb48-a3d868dc70d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.083237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15f7b4-c1bd-4830-bb48-a3d868dc70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.083547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15f7b4-c1bd-4830-bb48-a3d868dc70d0 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/b1d2810610e748859ea9ff10d45190b1/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.104399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15f7b4-c1bd-4830-bb48-a3d868dc70d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=b1d2810610e748859ea9ff10d45190b1, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.107122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15f7b4-c1bd-4830-bb48-a3d868dc70d0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.130101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 274/553] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:53 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/b1d2810610e748859ea9ff10d45190b1/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:53.257585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a05cd5-3daa-465e-8419-b366264accd8 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.257933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a05cd5-3daa-465e-8419-b366264accd8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.258108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a05cd5-3daa-465e-8419-b366264accd8 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.260300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 280/554] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:53.266624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.266969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.267225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.296424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:53.297683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:53.369938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 275/555] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:53.414866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a05cd5-3daa-465e-8419-b366264accd8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.429176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a05cd5-3daa-465e-8419-b366264accd8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.433736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.434523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.434806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.435110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.450987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:53.459370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:53.460884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 281/556] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.467284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.477073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4115ae-541e-4347-8ba3-d778e92bb6ab None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.487268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.488190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.488474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.488749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.495805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.496130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.497749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.507071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 276/557] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:53.512845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.528302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a839f4-eed8-4100-88f0-59d774f94983 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.537497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.538514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.539025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.539616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.558959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.561212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.581869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:53.584109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 282/558] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.591923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.605801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf47c-918e-4505-96df-5b000261240e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.621155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.621824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.622108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.622387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.623153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.623464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.625060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d85fb4-306a-4fcc-b5c6-013ad009105c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.645181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 277/559] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:53.651670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.666915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38f2b-fb4b-442f-93d4-bae3a67ccf77 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.675996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.677085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.677646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.678143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.686574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7333a-07c9-4ab3-9679-b1ffd5765a94 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.686873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7333a-07c9-4ab3-9679-b1ffd5765a94 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.687200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7333a-07c9-4ab3-9679-b1ffd5765a94 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.688990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 278/560] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:53.695954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.698346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.700807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.701096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.701373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.714401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 14 03:02:53.716224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 283/561] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.728170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.740545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:53.741723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:53.746370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2b8a-d499-490f-ba67-00c7797a1208 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.755476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 279/562] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:53.756922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.757587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.757868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.758144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.758992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.759329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.761240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.780127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 284/563] 10.222.0.43 () {56 vars in 1158 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:53.788546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.795475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.799829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133962f-2e63-4b7c-ac9a-fd15094f1c93 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.807643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.808953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.811104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.811432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.820177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5ce3-adac-496e-a7e5-ad66304a9a42 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.827565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273747-d310-4f58-8dd4-d82f9429cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.828348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273747-d310-4f58-8dd4-d82f9429cbff admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.829699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273747-d310-4f58-8dd4-d82f9429cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.829991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273747-d310-4f58-8dd4-d82f9429cbff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.831267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.836214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.853278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273747-d310-4f58-8dd4-d82f9429cbff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:53.861283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-52273747-d310-4f58-8dd4-d82f9429cbff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:53.862870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 285/564] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.864116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1110-01ee-4452-a7f9-23c3ca30cd79 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.864399 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1110-01ee-4452-a7f9-23c3ca30cd79 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.864698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1110-01ee-4452-a7f9-23c3ca30cd79 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.871459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 286/565] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:53.871600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:53.871600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 280/566] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.873118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1110-01ee-4452-a7f9-23c3ca30cd79 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.877655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.886761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4443-2440-4a6a-b23a-093df0d0fb32 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.887517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1110-01ee-4452-a7f9-23c3ca30cd79 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.891774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.892469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.892760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.892881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.893036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.893860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.894036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.894349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.894689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.895218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.896544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.896935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.897395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.899213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db038a60-d28d-46d1-9ead-b1878de43674 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.908513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 287/567] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:53.912780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 281/568] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:53.912892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.912892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.912892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.914763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.924977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc36fd-a4fa-4c36-80ac-f66e088cc6b0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.930349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.931147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.931434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.931709 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.933882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:53.935418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:53.943690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.951088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.951353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 288/569] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:53.952440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.963181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:53.965179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 282/570] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:53.968341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948df04-a28a-4e64-819e-33506c55e9b1 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.971139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:53.981989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.982785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.983086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.983357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.986070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ffbd5-2a49-48f9-89fd-0dec5344ca70 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:53.991578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.993535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:53.995677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:53.996313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:53.996587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:53.996853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:53.997573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:53.997872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:53.999617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139e0fb-4d41-4b41-9d28-e5b86e411e7f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.010915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:54.012266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 289/571] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.012509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 283/572] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.012892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.013738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd986cf-0f54-4e1b-a528-e4d79023bf46 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.014022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd986cf-0f54-4e1b-a528-e4d79023bf46 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.014445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd986cf-0f54-4e1b-a528-e4d79023bf46 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.016332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 284/573] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:54.018888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd986cf-0f54-4e1b-a528-e4d79023bf46 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.028884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824c56-fc3b-45db-b15d-67aefcb3325d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.031955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd986cf-0f54-4e1b-a528-e4d79023bf46 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.033199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.033964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.034233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.034505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.036314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.037225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.037225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.037501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.044756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.045518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:54.046733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.052359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:54.053683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 290/574] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.054281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.062147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8b05a7a4-945c-442f-b98e-2ab97f18dce2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 14 03:02:54.063508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 285/575] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:54.064527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.064809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.065078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.068929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8900ec-488f-4c12-bd57-78098a5b24e0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.073676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.074368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.074689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.074963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.075820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.076237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.077974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.082821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:54.084639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:54.091433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 291/576] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.092221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.097435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 286/577] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:54.098093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.101480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d1c6e-3234-4837-a102-f6e4e159ef16 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.106453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.107319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.107741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.108181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.109178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.109618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.109728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40105b4a-6e65-4cf0-a44c-d1c886c991de None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.111596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.115124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.115887 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.116274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.116713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.117658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.118068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.120897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.122074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 292/578] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.123002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.132915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4179-5e18-4dce-bc8b-f4419667cb27 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.137347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.138198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.138479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.138753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/647e47606fc9438cb580f58fe7daae4f/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.141686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 287/579] 10.222.0.43 () {56 vars in 1158 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.142494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.152487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a485-aa02-4b4d-8394-5d9b353ecafd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.156954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.157720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.157996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.158265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.160086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=647e47606fc9438cb580f58fe7daae4f, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.162883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.169559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:54.176706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:54.177056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 293/580] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:54 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/647e47606fc9438cb580f58fe7daae4f/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:54.178128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 288/581] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.179080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.183751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.200993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2237169-4e63-4ff5-bc36-df25f5e57069 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.258994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b45e7-c73e-431f-930a-57d12d472443 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.263769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.264768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.265097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.265380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.276212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.277557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.277684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.278090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.278506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.279738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.291841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.293926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.299223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:54.300883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 294/582] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.301924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.313056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef361c-5405-4644-b7e9-3865f2f9068b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.314734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:54.321879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.321879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.321879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.321879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.322313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.322433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 289/583] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.322527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.323648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.324334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.335325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75d4c8-7591-458d-b5b1-63fd09572a2b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.339149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 295/584] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.340785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.346500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.347526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.347969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.348475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.349494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.350006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.351696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a16d-446b-4f63-a1ee-d72560b38432 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.352073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.357187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.357857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.358137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.358408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.359221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.359524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.361231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.377021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 290/585] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.377905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.382045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 296/586] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.383101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.389468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e484d3-57e4-47b0-90a0-c203d2951cfe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.395352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.396239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.396522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.396787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.397833 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2f4c-f6c5-4eb4-9bf8-27856508db29 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.403035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.404057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.404477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.404879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.414736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.416314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.416662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.418671 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.433551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 14 03:02:54.434371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:54.435108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 297/587] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.435893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.439120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 291/588] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.442456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.453573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d82b-5963-4baf-a20f-0515570b985d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.454652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f970121-7c0d-4c4e-83cd-c6626d18161d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.458114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.458869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.459998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.460136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.460136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.460288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.460417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.460679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.460774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.462544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.464325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.467944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.469879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.482835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:54.484368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 298/589] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.485143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.488486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 292/590] 10.222.0.43 () {56 vars in 1160 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:54.492422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.506176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87f7c-fbe3-46c2-b024-f9710c7d6942 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.507551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210bfe8-96fc-46f1-8d41-a1342bd53771 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.511844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.512234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.512845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.512976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.513138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.513498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.513631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.514027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.514232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.514532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.515267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.515708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.516227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.518184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.533470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 299/591] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.533470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.538749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 293/592] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.539980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.549644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6bc7b-0272-48ea-a0ca-618bd0666a72 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.550981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6cdd-7d9c-48d0-97ab-2b8599bdfd49 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.554271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.555192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.555574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.555931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.556752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.557671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.558275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.558683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.567382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.568567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.569486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.571067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.586475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 14 03:02:54.586653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:54.592923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 300/593] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.593496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.595146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 294/594] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.596125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.604789 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66403cdd-8723-42cc-a06b-56dde0bd7ca8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.608452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bac7-8cf8-42aa-9eee-11f2db6a94cd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.610382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.611389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.611762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.612064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/1a9f0d0a342649658a174da2d495fe8d/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.614303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.615344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.615763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.617042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.617919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.618360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.620096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.629976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=1a9f0d0a342649658a174da2d495fe8d, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.633352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.636303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 295/595] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.637758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.649215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48223ce-74db-4681-b844-c08357e5c066 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.654193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 301/596] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:54 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/1a9f0d0a342649658a174da2d495fe8d/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:54.660199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.768040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.768719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.769000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.769282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.770139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.770446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.774535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.792771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70733-229f-4706-b014-8bfc81d68029 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.804519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 296/597] 10.222.0.43 () {56 vars in 1156 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:54.807387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.808445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.808952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.809546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.810518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.831151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6bf5b-e954-4502-a6dc-b986373502fc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.833163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.835809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.845765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.846420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.846697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.846967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.860698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:54.867325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 302/598] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.869584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.869698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.871567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.880950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa7a0-cc8f-4db2-b448-c402e868ae52 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.886329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.886980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.887292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.887561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.888359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:54.888663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.890524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.894512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 297/599] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:02:54.908106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.909122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 303/600] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:54.915728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.921393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dbfd4-231d-40a9-b190-3e1b054974b3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.925544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c47c-af98-4bc7-82a0-cce12300c26b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:54.929435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.930695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.931336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.931873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:54.932119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.932817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:54.933089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:54.933363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/5f08db48e9814f7db34ffcf7d581fc12/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:54.947660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.950024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.950392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=5f08db48e9814f7db34ffcf7d581fc12, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:54.953359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:54.969431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:54.970985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 298/601] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:54.978354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 304/602] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:54 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/5f08db48e9814f7db34ffcf7d581fc12/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:54.979276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:54.990402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733d48-d58e-49d4-960f-e805868c98ec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:55.051686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:55.052884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.053161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.053431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:55.054165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:55.054468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:55.056252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:55.069545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 299/603] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:55.075906 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:55.090686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b1d9-9582-4a4c-a9b3-1fca09e87eb3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:55.095714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:55.096615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.096987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.097311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:55.108428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:55.110492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:55.129473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:55.135714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 305/604] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:55.142208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:55.153633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33724dfa-e129-4735-8254-d03482cd1fb4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:55.159461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:55.160127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.160399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.160672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:55.161524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:55.167683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:55.169715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcb84c-415e-4022-85c1-238c65258879 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:55.189836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 300/605] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:55.197134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:55.216611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8fb82-e6e3-4a30-8ea6-c01223597934 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:55.223286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:55.224049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.224332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.224639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:55.225504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8abbf99271a142d0b6b33194845916aa) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:55.225847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:55.227869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61d19c-68e4-46bd-b512-63e943260255 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:55.239008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 306/606] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:55 2021] GET /identity/v3/role_assignments?user.id=8abbf99271a142d0b6b33194845916aa&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:55.913464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa48e4-4e0d-4489-8a60-f07e1e739398 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.914118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa48e4-4e0d-4489-8a60-f07e1e739398 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.914118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa48e4-4e0d-4489-8a60-f07e1e739398 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:55.915957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 301/607] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:55.921795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.922268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.922415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:55.944231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:55.945402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:55.953251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 307/608] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:55.977589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa48e4-4e0d-4489-8a60-f07e1e739398 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:55.990188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa48e4-4e0d-4489-8a60-f07e1e739398 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:55.994500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:55.995307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:55.995584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:55.995855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.006517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:56.013223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:56.014692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 302/609] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:56.021333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.030225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbc007-5a20-469d-8567-f483c383853b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.034759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.035435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.035711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.035980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.037293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:56.037598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.039199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.047893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 308/610] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:56.053758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.063993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41dc6e-6f80-4a38-8ac6-33530a2e0bc3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.068662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.069442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.069719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.069987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.081487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.083830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.100963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:56.102430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 303/611] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:56.108356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.118148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c7100-a759-4f67-a665-500ef905dc99 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.122527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.123195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.123474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.123742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.124463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:56.124758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.126324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.142046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 309/612] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:56.148767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.158402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de56c7-7edd-4947-91f9-06e57d9f0db2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.171747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.172473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.172753 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.173026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.181444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.183460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.200380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:02:56.201820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 304/613] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:56.207738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.218291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d678f-b8b4-45c2-9125-3f0560bcfdbd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.222866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.223556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.224034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.224341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.225240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:56.225540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.227490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.254590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 310/614] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:56.261097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.271695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223a15-9587-4c18-8e7a-5d3ccd954ef3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.282842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.283578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.283910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.284185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.293015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.294789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.308696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 305/615] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:56.314737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.325111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c11bf-2733-4ede-8f1d-4b0fd1750780 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.329650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.330482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.330764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.331034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.346757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.348748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.370738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:56.372147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 311/616] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:56.378106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.387635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a863da-4d42-4c2d-9e8a-db607b7fe849 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.392312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.393002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.393278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.393594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.394319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:56.394617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.396872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.409631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 306/617] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:56.415527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.429212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9bd8-2ec8-4dcc-b3a9-9b7ca8e0c87e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.433891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.434861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.435210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.435481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.449107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.451173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.465018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:56.466629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 312/618] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:56.473051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.483768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8bcc-6888-4e0c-89a9-23d61d596fc3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.489011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.490287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.490613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.490891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.491790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:56.492099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.494058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32212f-6558-46fa-b9c8-bc2aaa0bba11 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.508332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 307/619] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:56.514663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:56.525178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97993153-207d-4e77-9a40-cf595f9f67f4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:56.529780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:56.530394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:56.530717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:56.530998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:56.531900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=b1d2810610e748859ea9ff10d45190b1) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:56.532206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:56.534187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408500b4-ed1e-467a-8659-902a3db8269b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:56.540863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 313/620] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:56 2021] GET /identity/v3/role_assignments?user.id=b1d2810610e748859ea9ff10d45190b1&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.099979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34ec4e-0d32-47f6-b23e-bce82141f0cf None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.100669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34ec4e-0d32-47f6-b23e-bce82141f0cf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.100669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34ec4e-0d32-47f6-b23e-bce82141f0cf None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.102518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 308/621] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:57.108527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.109003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.109173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.128202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:57.129437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:57.138300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 314/622] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:57.163343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34ec4e-0d32-47f6-b23e-bce82141f0cf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.176210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34ec4e-0d32-47f6-b23e-bce82141f0cf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.182584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.183411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.183691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.183962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.194759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:57.201634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:57.203142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 309/623] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:57.209299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.218422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a43d4f-3c21-4f38-a9a3-940abfcda2fc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.223721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.224917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.225194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.225465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.226227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.226528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.228146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.236940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 315/624] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.243636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.254035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90383-b353-40da-a163-fc2d7b9836dd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.258595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.259436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.259717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.259995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.273508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.275367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.293107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:57.294528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 310/625] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:57.300672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.310792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef925c-1e66-48c4-bd99-c713563060f0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.315422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.316115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.316397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.316670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.317455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.317791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.319468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537f32-ac4f-405a-8c1b-1d72d0c6fc0b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.332213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 316/626] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.338638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.348599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89faa6d-4051-49c6-b6e6-4e7de40e33d2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.354645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.355456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.355793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.356067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.364915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.366988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.380796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1844-1e8b-4ab6-a4af-6808b562afb2 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.381072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1844-1e8b-4ab6-a4af-6808b562afb2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.381339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1844-1e8b-4ab6-a4af-6808b562afb2 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.383439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 317/627] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:57.383643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 14 03:02:57.384946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 311/628] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:57.390255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.390759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.391265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.392501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.405091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf0f5-cf63-4d18-b1cc-e888127f897e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.412714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:57.414250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:57.419769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.420464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.420748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.421029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.421896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.422208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.424152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.424899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 318/629] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:57.447821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 312/630] 10.222.0.43 () {56 vars in 1158 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:57.453995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.461566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.469824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3401bb-ff23-45fe-ad14-720c929ba123 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.471518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4982d-2823-43f5-87cd-5fa81e6eb285 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.478582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.478954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.479424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.479707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.479982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.480579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.481148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.481630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.492685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.494717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.497834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:57.504819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 319/631] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:57.505055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:57.506230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 313/632] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:57.512085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.513694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.522198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef9cf5-9ebf-4834-a2ce-e8c609e4b8d2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.527652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.528450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cba75-c073-4342-8d48-da38bd658882 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.528856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.529328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.529789 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.541141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.541811 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.542147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.542360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.542458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.543203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.543609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.544919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.545244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.562090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 314/633] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.564690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:57.566387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 320/634] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:57.567976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.572061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.588914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2cbe0-b6ae-4bc8-93bd-f23c1769eab0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.591927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06192459-16b7-4d5f-bc1d-55aec10f066b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.600186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.601679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.602584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.603567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.603760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.604491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.604847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.605255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.605757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.606227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.607194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.618633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.621334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.638173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 321/635] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.643856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.645435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:57.651324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 315/636] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:57.657308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.663828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e32ca-5887-4432-99cb-f73c0cf403e7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.672680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178b583-f37b-4f79-aadd-b3fb035b7c73 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.674664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.675820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.676635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.677144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.684418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.686540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.687034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.687967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.690904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.691452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.694261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.695197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.697435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.721583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 316/637] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:57.722879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:57.724592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 322/638] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:57.727191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.730981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.749176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce86b9-41d7-4d5d-a370-28d7bb0253bf admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.750301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83bf3c-c0e7-4f4d-bfbb-cb83c99c79fd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.759372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.760702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.761550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.762090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.763101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.763620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.764608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.765076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.765588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.766156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.768583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.783603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.789802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.797943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 323/639] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.804757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.815879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 14 03:02:57.819942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefc4e-4438-4e6e-a40f-2142f3901ee1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.821364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 317/640] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/users/glance => generated 84 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:57.826271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.827682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.832444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.832998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.834083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.835815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=647e47606fc9438cb580f58fe7daae4f) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.838371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.843801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079243-5666-4e5c-b0d0-e1160a1e4295 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.845696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edfe63-b08b-4492-b364-bc851288d1a9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.850141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.851202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.851710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.852244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.853398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:57.853918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.855628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 324/641] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/role_assignments?user.id=647e47606fc9438cb580f58fe7daae4f&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:57.856646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.857038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946feb0a-c0d8-40d0-9b0b-2a31839d5d37 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.857325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946feb0a-c0d8-40d0-9b0b-2a31839d5d37 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.857598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946feb0a-c0d8-40d0-9b0b-2a31839d5d37 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.863210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 325/642] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:57.868678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.869027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.869239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.882563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 318/643] 10.222.0.43 () {56 vars in 1158 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:57.888437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.900777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:57.902279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:57.905205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d3ea-3649-452c-a5f7-43d9f26afe01 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.914361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.915007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.915317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.915588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.918570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 326/644] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:02:57.934906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.936749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.949308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 319/645] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:57.955142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:57.965729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73009-0e93-46a4-b4ff-20e28710f6b9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:57.975512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:57.976326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:57.976606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:57.976880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:57.992778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:57.994688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:57.996516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.008478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc9da-3863-4af4-ba2a-0c5567b27d6f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.019421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.020602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.021127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.021600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.024735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:58.026124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 327/646] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.032066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.035346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:58.042842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:58.044823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 320/647] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:58.054445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04a08-b689-4dfc-a011-18bb8042ef0f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.056003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.067533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.068821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.069092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.069362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.070120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.070418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.073129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.073376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362e59-008b-4591-a50a-386a1fbfd69b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.081649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.082984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.083743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.084186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.085090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.085557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.085776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 328/648] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.087510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.091771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.098503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 321/649] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.105867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.111635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195229b4-2635-415d-82d6-1e954c96c16b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.117165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850779ed-8f03-4eef-b73d-3a1afff04d18 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.120875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.121727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.122074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.122453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.123286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.124300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.124759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.125332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.136440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.139337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.140000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.142499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.156802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:58.158500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 329/650] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.161210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:58.163382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 322/651] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:58.167183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.169824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.178181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa933a-1aae-4472-90b5-fc068f082afa admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.183441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324764-fa8b-4e70-9d24-85503f71abae admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.184224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.184862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.185136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.185411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.186197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.186500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.188354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.190586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.191992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.192493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.193614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.194596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.195155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.197581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.201617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 330/652] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.209215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.211661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 323/653] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.217658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.220331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb386ac-57b5-4d69-a02d-9d3d4a31fb1b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.225735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.226629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.226922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.227424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.228263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=1a9f0d0a342649658a174da2d495fe8d) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.228580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.229804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41948d-0543-4ace-a886-186c28081619 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.230407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.235917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.236735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 331/654] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/role_assignments?user.id=1a9f0d0a342649658a174da2d495fe8d&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:58.237524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.238451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.238948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.256565 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.259140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.274428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-7857ab96-750f-4ddd-b98d-5f7f2c4643eb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 14 03:02:58.276369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 324/655] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.282285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.293907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90012262-1c71-4f50-8422-6e2fd6bec4d8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.298490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.299177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.299457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.299725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.300574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.300872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.303277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.317104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f3d8-b323-4aa8-a392-b9052475d47b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.318386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f3d8-b323-4aa8-a392-b9052475d47b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.318871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f3d8-b323-4aa8-a392-b9052475d47b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.321425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 325/656] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:02:58.327059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 332/657] 10.222.0.43 () {56 vars in 1160 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.328287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.331172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.331172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.332317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.343732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b199-81a5-41a0-901b-9bd7742c85b8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.349482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.350333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:58.350562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.350976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.351410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.352106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:02:58.360377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 326/658] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:02:58.361294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.363525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.374200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 333/659] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:02:58.380181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.386992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.391016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec396-5f7f-4362-90f4-e8afaa72fff3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.396168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.397193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3e3b-8b59-414c-93db-982c205f8154 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.397553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.398085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.398659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.402202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.403212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.403599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.403938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.412520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.414593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.425078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:02:58.433034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:02:58.434092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:58.435447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 334/660] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:58.435747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 327/661] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:58.443927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.444103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.464518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd46d1f-dab9-4592-9c8a-4f6a91b5fc52 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.468049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d2d2-98cf-49fd-b638-0f22e54ccc99 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.477200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.478099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.479152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.479429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.479798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.480118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.480382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.481151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.481463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.482258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.482562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.483208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.484904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.486406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.502792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 328/662] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.507167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 335/663] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.508278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.512981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.523948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6f19-d449-487f-b07a-c771c29bb454 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.528019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a9dd-26c8-4ccf-ba84-9d1c110485e3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.531069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.532292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.532861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.533429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.533682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.534473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.534732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.535019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.548068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.550680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.553232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.555355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.569122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:58.570649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 336/664] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:02:58.573750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:58.573750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 329/665] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.579224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.579753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.589512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc92ef7-3433-4497-a97f-c6019a592464 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.593045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dbafc-2db0-4728-923b-97f9cd685c5a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.594892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.595633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.595917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.596190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.597090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.597396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.599745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.600051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.600810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.601278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.601946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.604612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.605135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.606939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.614295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 330/666] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.620876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.622689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 337/667] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:02:58.630372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.631654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c8348-c527-4621-9aa9-f20a7a3399aa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.636596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.637296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.637587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.637863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.639784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=5f08db48e9814f7db34ffcf7d581fc12) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.640483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.642446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.643925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd13205-f211-4c4b-93e6-5e2c0889a39d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.650537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 331/668] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/role_assignments?user.id=5f08db48e9814f7db34ffcf7d581fc12&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.651084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.652182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.652670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.653134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.662498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.664780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.689087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 14 03:02:58.691125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 338/669] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.697503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.709354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b39981-5ed6-41c8-a846-ad02be2ae621 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.714572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.715733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.716298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.716798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.717936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.718458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.720791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.750625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 332/670] 10.222.0.43 () {56 vars in 1156 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.756704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.766857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94cb1-3d5d-4646-b41c-0a9ad857e3cd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.772086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.772878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.773156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.773426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.784817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.787281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.805882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:02:58.811166 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 339/671] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.813699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.829018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6b0d9-2992-4cce-a8ff-e1cd3711b252 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.834520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.835403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.835789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.836162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.837011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.837424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.839162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.853921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 333/672] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.860448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.871958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b93fb-985a-4ed5-bf77-9f8ac3886468 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.878070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.879236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.879658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.880140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.888270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.890457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.907196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:02:58.908613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 340/673] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:02:58.915574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.925592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909c947-cfeb-4ebe-b4f0-9b48b871fc5e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.930250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.931067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.931486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.931911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.932830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:02:58.933268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.935238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623d642-4b90-429e-b6fa-2ad9f80f7d39 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:58.953339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 334/674] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:02:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:02:58.954930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:02:58.965970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7beee-5dc7-4a71-ba67-82bf0180ea8c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:02:58.970575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a29f0-da8d-45b9-a8fe-058a2e4d487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:02:58.971519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a29f0-da8d-45b9-a8fe-058a2e4d487f admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:58.971851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a29f0-da8d-45b9-a8fe-058a2e4d487f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:58.972124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a29f0-da8d-45b9-a8fe-058a2e4d487f admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8abbf99271a142d0b6b33194845916aa/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:58.988059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a29f0-da8d-45b9-a8fe-058a2e4d487f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=8abbf99271a142d0b6b33194845916aa, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:02:58.990768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a29f0-da8d-45b9-a8fe-058a2e4d487f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:02:59.008506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 341/675] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:02:58 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8abbf99271a142d0b6b33194845916aa/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:02:59.939346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ab02-6122-4dbb-8089-0f35b1b63f7e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:59.940320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ab02-6122-4dbb-8089-0f35b1b63f7e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:59.940794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ab02-6122-4dbb-8089-0f35b1b63f7e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:59.943070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 335/676] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:02:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:02:59.956924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:02:59.957342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:02:59.957536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:02:59.981352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:02:59.982597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:00.057884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 342/677] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:02:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:03:00.101836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ab02-6122-4dbb-8089-0f35b1b63f7e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.115305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ab02-6122-4dbb-8089-0f35b1b63f7e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.126871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.127930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.128426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.128901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.139866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:00.147005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:00.148777 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 336/678] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:00.154635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.164263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b079-3285-4730-9507-a6ac83abca48 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.179747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.180417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.180824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.181096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.181923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:00.182222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.183954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.193421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 343/679] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:00.198905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.208799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee9042-ac21-4e73-aca8-3b31830a4782 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.218608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.219656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.220132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.220595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.239138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.241891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.262918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:00.264488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 337/680] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:00.270491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.288172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13250d43-eb40-4f08-8192-72b5e6211c47 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.293975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.294679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.294960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.295256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.296086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:00.296386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.298035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.317217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 344/681] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:00.322919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.339068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19dba-b2a4-4a28-9cd0-ff34df9d2f04 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.343913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.345046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.345520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.345982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.369037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.371496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.389466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:03:00.391066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 338/682] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:00.397746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.416210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953fd84-b9c7-4c71-a3df-f53d0b7ddfbe admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.427663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.428369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.428693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.428965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.429847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:00.430155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.432067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.454924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 345/683] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:00.461004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.479064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106b57-18df-4a3f-8401-10bdf56b1fd4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.483824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.484669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.485139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.485619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.494268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.500291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.513720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 339/684] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:03:00.519901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.532708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9564a-1035-4358-a228-b01760977419 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.543223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.544111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.544442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.544718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.557260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.564510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.586181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:00.587996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 346/685] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:00.593707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.613745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf880bef-d54a-4fa3-917d-1f3fdd30669c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.618714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.619612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.620109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.620571 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.621503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:00.622002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.623792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.641451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 340/686] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:00.648321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.661068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3b9e4-e4d0-4b6b-8cde-bb97b56f81d2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.673417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.674259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.674617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.674899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.686319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.688437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.707276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:00.709234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 347/687] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:00.715278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.731077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b1af-d355-4e54-bb1c-692aab173023 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.735903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.737081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.737900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.738388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.739413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:00.739926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.742017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1e0d0-253b-4005-a15c-02fe09c136ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.762973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 341/688] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:00.769324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:00.782037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2aeb3-3f6c-47d1-8f27-14d87f4caad3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:00.792662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:00.793415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:00.793746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:00.794065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:00.794907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=b1d2810610e748859ea9ff10d45190b1) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:00.795285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:00.797180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feba13-01aa-4814-9aaf-aff05109fb37 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:00.803528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 348/689] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:00 2021] GET /identity/v3/role_assignments?user.id=b1d2810610e748859ea9ff10d45190b1&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:01.033980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b580d4-16a2-46c8-ac08-9a24b3533588 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.034966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b580d4-16a2-46c8-ac08-9a24b3533588 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.035480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b580d4-16a2-46c8-ac08-9a24b3533588 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.037625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 342/690] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:01.044205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.044774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.044774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.072331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:01.073600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:01.082065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 349/691] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:03:01.105001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b580d4-16a2-46c8-ac08-9a24b3533588 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:01.118636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b580d4-16a2-46c8-ac08-9a24b3533588 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:01.127927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:01.129090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.129618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.130691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.131594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:01.132896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:01.132896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:03:01.132896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:03:01.134097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:01.153411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 14 03:03:01.156012 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 343/692] 10.222.0.43 () {56 vars in 1150 bytes} [Tue Dec 14 03:03:01 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:01.161322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:01.176215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460294a2-4d95-4ae2-ba01-afbe79699c34 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:01.191680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:01.192350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.193202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.193477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.194213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:01.194516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:01.195568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:01.195568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:03:01.195568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:03:01.196428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52491739-569c-42a5-91e7-3b3a9cf15c23 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:01.201608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 350/693] 10.222.0.43 () {56 vars in 1145 bytes} [Tue Dec 14 03:03:01 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:01.207368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:01.217908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34893ac-ee41-4bfe-a7fe-86958c2e2f32 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:01.222503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:01.223387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.223894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.224358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.225272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:01.225762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:01.226950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:01.226950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:03:01.226950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:03:01.228189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2afc-eddd-4d5e-abb2-0ea652470a24 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:01.234557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 344/694] 10.222.0.43 () {56 vars in 1145 bytes} [Tue Dec 14 03:03:01 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:01.478645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2e8ae-f6f6-4c0a-9249-bf82052c1aca None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.479065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2e8ae-f6f6-4c0a-9249-bf82052c1aca None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.479243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2e8ae-f6f6-4c0a-9249-bf82052c1aca None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.481354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 351/695] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:01.487169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709328f5-8f63-4317-865f-241a40036049 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.487459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709328f5-8f63-4317-865f-241a40036049 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.488002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709328f5-8f63-4317-865f-241a40036049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.513232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-709328f5-8f63-4317-865f-241a40036049 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:01.514455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-709328f5-8f63-4317-865f-241a40036049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:01.523397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 345/696] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:03:01.550109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2e8ae-f6f6-4c0a-9249-bf82052c1aca None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:01.564675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2e8ae-f6f6-4c0a-9249-bf82052c1aca None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:01.570543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:01.571339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.571620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.571895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.584648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:01.586458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:01.610520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:01.612066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 352/697] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:01.618813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709328f5-8f63-4317-865f-241a40036049 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:01.632109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709328f5-8f63-4317-865f-241a40036049 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:01.645250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:01.645982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.646265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.646541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.647303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:01.647612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:01.649205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038f07-9569-4832-aeb1-9ace35591384 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:01.682593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 346/698] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:01.689000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:01.709822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276650-944d-4296-a701-76020d684be9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:01.723720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb57791-cc31-4cac-9742-fc6a18c921f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:01.724939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57791-cc31-4cac-9742-fc6a18c921f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.725219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57791-cc31-4cac-9742-fc6a18c921f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.725492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57791-cc31-4cac-9742-fc6a18c921f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.726216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb57791-cc31-4cac-9742-fc6a18c921f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:01.728181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb57791-cc31-4cac-9742-fc6a18c921f9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:01.761143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 353/699] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:03:01 2021] POST /identity/v3/users => generated 254 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:01.948959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99ef4-5fa9-45c0-9dc7-592daf1ba13a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.949336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99ef4-5fa9-45c0-9dc7-592daf1ba13a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.949508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99ef4-5fa9-45c0-9dc7-592daf1ba13a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.951496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 347/700] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:01.957558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:01.957846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:01.958162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:01.984299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:01.985538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:01.996767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 354/701] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:03:02.039369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99ef4-5fa9-45c0-9dc7-592daf1ba13a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.057164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99ef4-5fa9-45c0-9dc7-592daf1ba13a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.070659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.071788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.072071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.072393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] PATH_INFO: `/v3/services/network` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.073064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.074722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.094035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1d733625-ea1b-4de0-9645-9dd433deb7cc admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 14 03:03:02.095620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 348/702] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/services/network => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:02.104082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.108201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25542c-79b1-4f93-aec3-0c1525ecf588 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.108490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25542c-79b1-4f93-aec3-0c1525ecf588 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.108769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25542c-79b1-4f93-aec3-0c1525ecf588 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.110828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 349/703] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:02.116352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136287-58d6-42e4-908f-007ab1d26f0a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.116862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.117139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.117412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.124214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.124884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.125149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.125420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.126142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.126446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.128069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.136071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 355/704] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.139001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:02.141432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:02.141929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.153986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93248860-6973-4904-807d-65d96edd7c67 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.158297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 350/705] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:03:02.159706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.160707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.161207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.161706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.162650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.163198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.165100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.171924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 356/706] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/services?type=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.182881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.193132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6153d0-f094-4766-8f82-84a5eaf36115 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.197848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.198661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.198940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.199250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.212045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:02.218953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:03:02.225672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 351/707] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:02.227259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.238784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ef147-197d-4452-9d54-cfa7620ca32b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.243589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.244348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.244629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.244898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.245672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.245969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.247627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.262335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 357/708] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.263974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.274735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e507-3ec7-48d1-9478-f9e40463c47a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.279671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.280473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.280805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.281077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.293985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.296009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.316189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:02.323232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 352/709] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:02.324868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.336100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a575c-d680-494a-85f1-e40721609ed7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.340974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.341701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.341981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.342256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.343105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.343414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.345377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.360711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 358/710] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.367683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.378198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1726b4-a3bc-4c7d-a6d6-6de3902d781c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.384855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.385705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.385984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.386254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.396588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.398749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.414051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 14 03:03:02.418716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 353/711] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:02.421888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.432814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398375-ca4c-432d-bec4-b58397d1e510 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.437368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.438063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.438344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.438615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.439616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.439917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.441791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.465020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 359/712] 10.222.0.43 () {56 vars in 1156 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.467435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.477698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c1ead-b65b-4844-a650-c06d1b1de378 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.482359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.482997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.483310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.483611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.493477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.495262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.504461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 354/713] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:03:02.511390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.521761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b78fd-9c57-4513-a5b0-07807a51ddfe admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.526283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.527148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.527432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.527746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.539229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.541059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.559435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:02.563160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 360/714] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:02.567281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.576502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cc1c1-a793-41cc-a287-32b1bb7cce9c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.581276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.581818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.582092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.582364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.583753 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.584067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.585760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.603427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 355/715] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.605685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.617547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c136e55-3f59-4286-bfeb-07903bf0e509 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.622190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.623014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.623323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.623593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.631280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.633286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.648412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:02.652438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 361/716] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:02.656401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.667025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc488a8-44f3-471a-aa68-d66853e13e35 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.671575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.672270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.672548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.672877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.673661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.674013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.675984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082aa3-5c70-4846-b016-091033f6e643 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.692209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 356/717] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:02.695364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:02.705964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ceaa-82c9-400a-85e5-3768082853b5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:02.711081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:02.711706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:02.712034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:02.712300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:02.713185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8abbf99271a142d0b6b33194845916aa) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:02.713483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:02.715393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b648b3-5f2b-4dc9-8381-8d34c89c7976 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:02.727180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 362/718] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:02 2021] GET /identity/v3/role_assignments?user.id=8abbf99271a142d0b6b33194845916aa&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:03.827308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9e999-c9d2-4c72-b66b-e8c210cda81d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:03.828301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9e999-c9d2-4c72-b66b-e8c210cda81d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:03.828820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9e999-c9d2-4c72-b66b-e8c210cda81d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:03.831077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 357/719] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:03.837724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:03.838136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:03.838327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:03.861069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:03.862257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:03.877006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 363/720] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 14 03:03:03.907273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9e999-c9d2-4c72-b66b-e8c210cda81d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:03.924849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9e999-c9d2-4c72-b66b-e8c210cda81d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:03.929678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:03.930450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:03.930734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:03.931009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:03.944705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:03.951389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:03.952564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 358/721] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:03.958835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:03.967861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b778f3-5570-4284-94c6-9424b8fb729b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:03.978576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:03.979252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:03.979532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:03.979799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:03.980556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:03.980861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:03.982445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d7759-94f0-4a8f-ba31-e2eb54b314a8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:03.991957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 364/722] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:03.998201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.007869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac532c-39e4-4321-a7e7-715a0477255b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.012264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.013031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.013315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.013587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.028124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.029943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.037356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd25d-c011-4941-b673-7fff97c57267 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.037640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd25d-c011-4941-b673-7fff97c57267 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.037916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd25d-c011-4941-b673-7fff97c57267 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.039940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 365/723] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:04.049445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.049731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.050007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.055567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:04.056995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 359/724] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:04.062714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.078708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a23f-dd19-4533-b0a1-91d5461955be admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.081882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:04.085340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:04.092358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.094286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.095155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.095863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.097457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:04.099867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.102217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.105349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 366/725] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 14 03:03:04.125442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 360/726] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:04.128244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.139925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1235c-07f3-4149-bcfe-93bb639f133b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.144848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.146304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.146790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.147319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.148315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.149530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:04.149530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:03:04.149530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:03:04.150813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.154631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.166531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb822-a25d-4688-b698-bc07e5d3c161 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.172198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.173217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.173754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.174230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.188641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.191212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.202215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 367/727] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:04 2021] POST /identity/v3/services => generated 251 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:04.206370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:03:04.208663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 361/728] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:04.214813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.261159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75901e-c674-4bf1-a15a-a84c7a0557ce admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.269350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.270041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.270326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.271243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.272130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:04.272439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.274334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.299498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 368/729] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:04.305365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.316453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9172d-d6aa-4b35-abe2-63c423e7ad85 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.321611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.322749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.323295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.323762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.337416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.339807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.358775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:04.360403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 362/730] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:04.366921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.385761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49af1-35e1-4cc9-a43b-e62941041197 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.396159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.396841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.397122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.397390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.398140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:04.398440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.400108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.421633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 369/731] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:04.427241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.437601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee03b6-b5ab-458f-addf-17b7c9e8b53b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.443216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.444500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.445009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.445514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.455329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.457569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.472344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:04.474264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 363/732] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:04.480264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.497236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84c63-a290-4c5f-b670-53dcd59dacc1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.503699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.504370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.504651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.505463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.506281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:04.506584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.508515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950accf5-59ff-4121-b4a4-b65e2272d775 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.524017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 370/733] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:04.530569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:04.540419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7bb0-1820-4839-807f-39e425dbea75 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:04.545881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa01e-5fdb-4682-a166-c11c339b2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:04.546737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa01e-5fdb-4682-a166-c11c339b2987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.547013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa01e-5fdb-4682-a166-c11c339b2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.547308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa01e-5fdb-4682-a166-c11c339b2987 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/b1d2810610e748859ea9ff10d45190b1/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.549921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aa01e-5fdb-4682-a166-c11c339b2987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=b1d2810610e748859ea9ff10d45190b1, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:04.552591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aa01e-5fdb-4682-a166-c11c339b2987 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:04.566533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 364/734] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:04 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/b1d2810610e748859ea9ff10d45190b1/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:03:04.952474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c770d3-9f5a-4866-835c-aa17c7fe99e3 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.952986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c770d3-9f5a-4866-835c-aa17c7fe99e3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.953088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c770d3-9f5a-4866-835c-aa17c7fe99e3 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.954781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 371/735] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:04.960801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:04.961541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:04.961970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:04.982838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:04.984877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:05.055388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 365/736] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:04 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:05.088715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c770d3-9f5a-4866-835c-aa17c7fe99e3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.111688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c770d3-9f5a-4866-835c-aa17c7fe99e3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.119617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412838e-56bc-4303-bcd6-f88e2438f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.120394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412838e-56bc-4303-bcd6-f88e2438f340 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.120675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412838e-56bc-4303-bcd6-f88e2438f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.120951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412838e-56bc-4303-bcd6-f88e2438f340 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.135883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412838e-56bc-4303-bcd6-f88e2438f340 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:05.142594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b412838e-56bc-4303-bcd6-f88e2438f340 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:03:05.144115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 372/737] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:05.150251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.159078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39dbd-8541-4258-9f63-9d77ccadaeae None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.159078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39dbd-8541-4258-9f63-9d77ccadaeae None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.159078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39dbd-8541-4258-9f63-9d77ccadaeae None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.159078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 373/738] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:05.163398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10909bbe-a88a-4717-89f4-bd318af7d0b9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.171123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.171935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.172362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.172795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.173688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:05.174134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.175890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.180055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.180513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.180928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.201092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 366/739] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:05.205097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:05.206500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:05.207088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.214797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 374/740] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:05 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:05.220065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d6f52-867d-4f34-9dbd-ce2e4493067f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.232595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.233378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.233662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.233938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.239931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.249072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91672fd-80d5-4042-8e7e-b56e40acc460 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.254002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.254936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.255362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.255533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.255966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.256937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.257184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.258988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.280351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 375/741] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:05 2021] POST /identity/v3/services => generated 240 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:05.288700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:05.290494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 367/742] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:05.296535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.321782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89f8a-c948-4045-859e-73fcd5d04687 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.330890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.331840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.332322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.332816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.333727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:05.334216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.336093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.350180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 376/743] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:05.356279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.369212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235041-93cf-4e5f-a940-fa8db0a7c3c9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.375921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.376925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.377349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.377789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.388799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.391101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.406114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 14 03:03:05.408100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 368/744] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:05.415102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.437583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60def8-2ead-465c-a988-ca3c431918ce admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.452904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.453578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.453945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.454224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.455087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:05.455446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.457225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.486742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 377/745] 10.222.0.43 () {56 vars in 1170 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:05.493374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.503311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb011-6e6b-493a-94e5-4532013ff979 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.517070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.517725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.517988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.518263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.527297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.529017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.545492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 369/746] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:05.551360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.564015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7863d-cf26-42d7-b128-8a54ddcc634a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.571261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.572088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.572333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.572602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.590970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.592868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.622299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:05.623851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 378/747] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:05.629690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.644538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba07a-a27b-4680-9422-6a41144cd34b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.658594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.660477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.660991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.662130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.663167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:05.663690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.665648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.685905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 370/748] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:05.691763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.713700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372c80-4197-447a-a318-df55f7bffd1f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.720280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.721084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.721366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.721637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.730912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.732988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.753041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:05.754550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 379/749] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:05.761417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.772247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4c3c-e5a0-48af-8f9f-f39e5ab94b07 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.777220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.778205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.778759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.779287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.780388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:05.780930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.783216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9d57f-5680-4c90-b69d-0b32d36381a5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.799502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 371/750] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:05.807679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:05.820549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b4f7c-a0a8-4b63-8270-292c9ff7a2f3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:05.826278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:05.827016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:05.827414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:05.827704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:05.828604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=f9a2e0f788614fe98b7e1d430d473a55) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:05.828914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:05.830868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfa695-a726-4397-b073-28123d4f7c75 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:05.846294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 380/751] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:05 2021] GET /identity/v3/role_assignments?user.id=f9a2e0f788614fe98b7e1d430d473a55&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:06.172512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff6f7-6a4b-4268-8ea1-c72b64ee7b4b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.173035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff6f7-6a4b-4268-8ea1-c72b64ee7b4b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.173035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff6f7-6a4b-4268-8ea1-c72b64ee7b4b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.175193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 372/752] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:06.181645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.182146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.182229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.208032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:06.209222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:06.220567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 381/753] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:06.257107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff6f7-6a4b-4268-8ea1-c72b64ee7b4b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.272331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff6f7-6a4b-4268-8ea1-c72b64ee7b4b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.278044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.278817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.279125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.279406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.294686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:06.301688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:06.303253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 373/754] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:06.309165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.323931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f23c2-ba0a-47a5-ace6-5749382b15a2 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.331060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.331719 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.331996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.332269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.333576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:06.333881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.335485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.351108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 382/755] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:06.357111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.371622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100383-20de-40c9-be57-73a7900df01d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.376186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.376959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.377290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.377568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.394659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.397198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.426164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:06.427394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 374/756] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:06.433635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.444431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baede694-2767-4fc6-93c6-3f902ac2e94f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.461122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.461786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.462068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.462340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.463096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:06.463400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.465007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.488946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 383/757] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:06.495021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.508073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e1afb-f6f0-48d8-b083-d20f4219b461 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.512867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.513648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.513981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.514261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.532248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.534332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.554585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 14 03:03:06.555848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 375/758] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:06.562067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.572423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0d4d-d4b1-4824-9977-553365f42c52 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.584042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.584751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.585031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.585301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.586205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:06.586509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.588520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.615388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 384/759] 10.222.0.43 () {56 vars in 1156 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:06.621834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.636522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af914f-d5f4-4583-9033-0979c24b642c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.641000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.641630 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.641912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.642184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.666064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.667856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.688769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 376/760] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:06.695568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.710341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6bcc5-c6da-4a0e-b4bc-e4df64b0e12d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.721170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.722076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.722401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.722680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.740457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.742351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.766002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:06.767234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 385/761] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:06.774081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.788588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89307c18-5578-412e-80fa-3c93826c8828 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.793142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.793797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.794082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.794357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.795102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:06.795409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.796987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.816329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 377/762] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:06.823033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.836561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082188cd-542f-41f8-8af1-ca1b0a8547a9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.844808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.845584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.845914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.846186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.858633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.860674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.874293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:06.875900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 386/763] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:06.882738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.892800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103bb5-adfe-472d-a308-8428c84f9373 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.898726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.899452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.899733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.900004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.900857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:06.901161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.903103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9359-c7f6-4751-862e-ba1c6120540e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.921523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 378/764] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:06.928030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:06.941046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c6abe-14d2-454a-8c8b-7cffd97d3781 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:06.947768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:06.948422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:06.948699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:06.949018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:06.949863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8abbf99271a142d0b6b33194845916aa) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:06.950220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:06.952177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046f77-ad5a-456a-aa4e-68e50be35f1a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:06.963481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 387/765] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:06 2021] GET /identity/v3/role_assignments?user.id=8abbf99271a142d0b6b33194845916aa&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:07.306745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3913cb-8797-412b-9a71-82bfe7edddef None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.307409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3913cb-8797-412b-9a71-82bfe7edddef None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.307409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3913cb-8797-412b-9a71-82bfe7edddef None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.309213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 379/766] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:07.315326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.315858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.315858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.334143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:07.335359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:07.343371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 388/767] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:07.367439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3913cb-8797-412b-9a71-82bfe7edddef None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.379677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3913cb-8797-412b-9a71-82bfe7edddef None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.384496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.385328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.385608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.385879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.386534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:07.388181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:07.399572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 14 03:03:07.401084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 380/768] 10.222.0.43 () {56 vars in 1150 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:07.407290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.416940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a64112-0d41-4c10-8242-43b55e62b02e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.421476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.422123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.422403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.422674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.423485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:07.423793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:07.425443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:07.431123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 389/769] 10.222.0.43 () {56 vars in 1145 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:07.437206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.447302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9f400-7b7f-47ee-9e4c-6f9ef0cdb88b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.451839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.452570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.452850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.453124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.453880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:07.454186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:07.455839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:07.461187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 381/770] 10.222.0.43 () {56 vars in 1145 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:07.467324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.477843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff07f46-ad8b-4647-be13-f51eb432044b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.482537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.483263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.483543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.483818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.484680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] RBAC: Adding query filter params (interface=public, service_id=7a6c6fded1014144952ad04d7c09d1b2, region_id=RegionOne) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:07.484984 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:07.486057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:07.486057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:03:07.486057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:03:07.486976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5b89-f72c-4aac-b92f-ac7060582589 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:07.496219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 390/771] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/endpoints?service_id=7a6c6fded1014144952ad04d7c09d1b2&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:07.502250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.512071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe965-274d-4c44-9674-2151800ada57 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.516729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edd20d-414a-4381-bf64-dcba07a2ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.517486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edd20d-414a-4381-bf64-dcba07a2ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.517765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edd20d-414a-4381-bf64-dcba07a2ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.518037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edd20d-414a-4381-bf64-dcba07a2ad4d admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.518781 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edd20d-414a-4381-bf64-dcba07a2ad4d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:07.520458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edd20d-414a-4381-bf64-dcba07a2ad4d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:07.525981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 382/772] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/services => generated 772 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:07.790540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dad3d-cc3b-49f7-b648-740111f5b789 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.790804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dad3d-cc3b-49f7-b648-740111f5b789 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.791111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dad3d-cc3b-49f7-b648-740111f5b789 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.793230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 391/773] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:07.799272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.799608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.799888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.824343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:07.825622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:07.834193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 383/774] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:07.859070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dad3d-cc3b-49f7-b648-740111f5b789 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.874295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dad3d-cc3b-49f7-b648-740111f5b789 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.881154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.882105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.882391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.882665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.898638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:07.905640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:07.907213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 392/775] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:07.913394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.922386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6bf1-32a0-454d-a0d0-f989ad4f0519 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.934415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.935440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.935883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.936313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:07.937221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:07.937671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:07.939484 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:07.954625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 384/776] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:07.960889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:07.974608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda08eff-93a3-44ed-8ef9-09f42ad883b2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:07.983306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:07.984095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:07.984376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:07.984650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.006280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.008202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.031997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:08.033559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 393/777] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:08.039682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.057161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecf1c7-079e-42a9-a225-9b75cfdf9c3e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.062035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.062978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.063509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.063992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.064935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.065446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.067811 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.093631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 385/778] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.099419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.112212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032dbdd-4eca-4709-a9ea-a82b9331df6d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.127713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.128513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.128794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.129066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.140211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.142223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.163015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:03:08.164286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 394/779] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:08.170480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.184503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01df38f-3963-4e8c-8de8-1f21e0667c64 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.196626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.197295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.197575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.197850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.198696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.199001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.200839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.230685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 386/780] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.236510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.251999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002e6a1-04d0-4d9b-8c8e-52a60031cc09 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.263643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.264282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.264564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.264838 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.275571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.277292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.294145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 395/781] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:08.300931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.315970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf55732-9395-4278-ae1a-6c0a21c2a916 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.328683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.329489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.329767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.330041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.352691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.354760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.374421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:08.376031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 387/782] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:08.382195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.396525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616411ea-15fa-46a1-bb30-916fc884a9ec admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.407164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.407829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.408110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.408382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.409161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.409413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.411545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc665ff-0d94-4643-8690-19e87516923d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.428942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 396/783] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.434660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.448032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e11f7a-2afa-43fa-829b-eb39110b66d8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.455243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.456139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.456485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.456763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.472249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.474742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.481565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170efc5-ca9f-4534-aa2d-40cffc7d471e None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.481897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170efc5-ca9f-4534-aa2d-40cffc7d471e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.482111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170efc5-ca9f-4534-aa2d-40cffc7d471e None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.484304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 397/784] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:08.493323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.493323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.493323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.498297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:08.500306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 388/785] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:08.507960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.522979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331efda-d26f-46c1-b95d-fbf84c59cac3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.531411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.533000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.534018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:08.534452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.534768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.535586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.535888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.537609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:08.539497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.554453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 398/786] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:08.565965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 389/787] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.567300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.576893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7304b-bcae-48dd-9dee-3a92ae904a41 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.581155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.585960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.586924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.587515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.588025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.589120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=b1d2810610e748859ea9ff10d45190b1) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.589641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.591586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ade88-ac81-4719-9244-a720d4c748ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.592130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.608590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 399/788] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/role_assignments?user.id=b1d2810610e748859ea9ff10d45190b1&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:08.609245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.610042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.610320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.610589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.611302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.613179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.624685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 14 03:03:08.626224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 390/789] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:08.632720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.659031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4d601-bc5b-4a60-9f4b-e16fc6c845f8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.684410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.684997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.685277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.685551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.686278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] RBAC: Adding query filter params (name=network) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.686580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.688199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.701250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 400/790] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/services?name=network => generated 124 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.707477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.717759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bc084-3553-4fe0-b02e-ad6121ff2fd9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.722615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.723346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.723662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.723987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.724717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.725077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.726736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.732614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 391/791] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.740684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.751998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527300ce-dc51-4a2e-a96f-e44da680af7d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.758818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.759541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.759821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.760093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.760955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] RBAC: Adding query filter params (interface=public, service_id=56c6f893b0934d67b95378e93c6b521b, region_id=RegionOne) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.761263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.762909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cb16f-e67d-4de8-a606-5d967d612982 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.768997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 401/792] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/endpoints?service_id=56c6f893b0934d67b95378e93c6b521b&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.775207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.788517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8701a-16da-41bb-b6d2-357fb958931f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.799222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14b74-a914-475f-8a21-852f8cef7eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.799940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14b74-a914-475f-8a21-852f8cef7eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.800223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14b74-a914-475f-8a21-852f8cef7eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.800493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14b74-a914-475f-8a21-852f8cef7eb0 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.801187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14b74-a914-475f-8a21-852f8cef7eb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.803474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14b74-a914-475f-8a21-852f8cef7eb0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:08.815212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 392/793] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:08.869520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02099ac8-393c-4e9c-9ed5-808b82bc8c10 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.869843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02099ac8-393c-4e9c-9ed5-808b82bc8c10 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.870058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02099ac8-393c-4e9c-9ed5-808b82bc8c10 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.871915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 402/794] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:08.878517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.878961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.879362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.899922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:08.901148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:08.915156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 393/795] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:08.933079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02099ac8-393c-4e9c-9ed5-808b82bc8c10 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.946575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02099ac8-393c-4e9c-9ed5-808b82bc8c10 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.950931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.951760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.952036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.952307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.965051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:08.972039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:03:08.973279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 403/796] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:08.979912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:08.989498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca67a-0c6e-451e-886c-d5aed891a872 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:08.994113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:08.994783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:08.995091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:08.995369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:08.996138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:08.996440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:08.998063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.013985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 394/797] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:03:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:09.015464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.026995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a865d5-f4de-48b6-9efa-c96e6f36ab2a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.031672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.032470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.032747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.033018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.044611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.046478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.064626 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:09.071202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 404/798] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:09.072997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.083677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9653-6aa4-48a8-b10e-523f80d6dc8f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.088371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.089034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.089313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.089585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.090324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:09.090624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.092387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.106979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 395/799] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:09.112992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.122847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff3f5-f0c0-4209-a6a9-ecdf28b02f25 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.127351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.128135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.128414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.128684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.136655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.138651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.155017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 14 03:03:09.157467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 405/800] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:09.162607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.172488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794294-1c6e-40a6-8af3-efe74bcbd733 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.177031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.177693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.177973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.178243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.179105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:09.179411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.181227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.203227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 396/801] 10.222.0.43 () {56 vars in 1170 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:09.205799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.216216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274288e-5ad3-4bf9-8298-fab62f5b86b2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.220659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.221421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.221695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.221959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.232542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.234368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.252343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:09.259071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 406/802] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:09.260450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.270174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7ed3-5385-4e90-b87c-a26ceb6e13ce admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.274696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.275372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.275651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.275925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.276646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:09.276947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.278522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.293385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 397/803] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:09.297819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.308378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363056dc-440a-4dbd-b33e-5c82780e0ad2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.312907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.313683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.313957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.314225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.321541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.323512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.337213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:09.343142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 407/804] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:09.344786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.355168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d822fb-c5ee-46ac-9967-f49815fa02df admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.363651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.364328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.364607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.364878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.365670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:09.365972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.367830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8588ede-57df-4f62-a3b4-2e1c58f68fde admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.384430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 398/805] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:09.390929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:09.406014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b666ed-3d1a-4a43-b63b-96c53de8fac1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:09.410577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4fcbd-825c-4c95-9e3b-7d6a15420b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:09.411520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4fcbd-825c-4c95-9e3b-7d6a15420b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.411794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4fcbd-825c-4c95-9e3b-7d6a15420b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.412095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4fcbd-825c-4c95-9e3b-7d6a15420b44 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/f9a2e0f788614fe98b7e1d430d473a55/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.426377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4fcbd-825c-4c95-9e3b-7d6a15420b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=f9a2e0f788614fe98b7e1d430d473a55, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:09.429565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4fcbd-825c-4c95-9e3b-7d6a15420b44 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:09.450043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 408/806] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:09 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/f9a2e0f788614fe98b7e1d430d473a55/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:03:09.965686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b70c-95e7-4662-bbbe-cfffe6ca0335 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.966033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b70c-95e7-4662-bbbe-cfffe6ca0335 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.966202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b70c-95e7-4662-bbbe-cfffe6ca0335 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.968207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 399/807] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:09.973826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:09.974111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:09.974386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:09.995552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:09.996731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:10.067521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 409/808] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:09 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:10.113356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b70c-95e7-4662-bbbe-cfffe6ca0335 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.128769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b70c-95e7-4662-bbbe-cfffe6ca0335 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.135633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.136411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.136693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.136969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.151921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:10.158599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:10.160131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 400/809] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:10.166242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.175331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73351949-bb3f-477d-9548-1ff8f2d88c13 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.180392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.181105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.181386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.181658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.182479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.182783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.184449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.193712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 410/810] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:10.199538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.212505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fec856-73a0-4069-86c1-5e6ee0b9af8e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.219260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.219983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.220245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.220522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.236546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.238652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.264181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:10.265384 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 401/811] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:10.271672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.283992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f590fa-cf4a-4b25-8c81-f5114c7ed666 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.292234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.292894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.293179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.293485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.294194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.294508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.296131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.310750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 411/812] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:10.316903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.332601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb488-98e3-4066-868a-b662effcce6e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.342024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.342810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.343138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.343414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.356189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.358207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.374513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 14 03:03:10.377587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 402/813] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:10.388372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.400522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb97e-92be-43bd-bd44-313bdf953fc1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.408643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.409296 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.409579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.409850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.410698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.411027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.412893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62c20-28ff-4894-8c8a-a6844db81937 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.436954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 412/814] 10.222.0.43 () {56 vars in 1156 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:10.443596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.460006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b07f3b-c799-4094-b55a-7f77d21739d7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.468199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.468977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.469257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.469583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.486273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1264b-d07e-4f1f-9768-d581b231b8f0 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.486940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1264b-d07e-4f1f-9768-d581b231b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.487448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1264b-d07e-4f1f-9768-d581b231b8f0 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.490645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 413/815] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:10.493283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.495156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.497004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.497301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.497579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.519687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:10.526629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 403/816] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:10.531968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.533434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:10.534678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:10.549510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235b37-efb9-4ec1-a3ef-e1859ce9a20f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.550739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 414/817] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:10.558046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.558861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.559271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.559615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.560739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.561110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.562924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.581139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 404/818] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:10.588238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.596616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.606404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f2a7-6818-4f7e-abe0-2d2219eae9be None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.616467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.617816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.618099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.618371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.623865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eb1a9-370b-45e8-94e9-e306679f603c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.633030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.634161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.634440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.635525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.636079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.638081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.638488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.640326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.652534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 14 03:03:10.658739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 405/819] 10.222.0.43 () {56 vars in 1150 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:10.665862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.675532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:10.677370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 415/820] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:10.684634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.694192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390ce59-f46c-4239-ae00-339b2eecb23a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.697645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1f7ec-a82a-4837-8297-8414f689c78b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.699695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.700605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.701092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.701559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.702479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.702986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.703121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.703932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.704231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.704633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.705488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.705799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.706305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.707724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.714328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 406/821] 10.222.0.43 () {56 vars in 1145 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:10.722573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.734144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 416/822] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:10.741160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.748117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8940c-db73-4173-964b-a1eea83db1e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.754572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f813bf1-3cad-4254-9823-e6689a9396e4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.758212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.759557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.760413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.761923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.763367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:10.764255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.767304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3e4ba-a2ab-4e5e-873b-a3b60eaf7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.768490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3e4ba-a2ab-4e5e-873b-a3b60eaf7582 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.769010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3e4ba-a2ab-4e5e-873b-a3b60eaf7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.769523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3e4ba-a2ab-4e5e-873b-a3b60eaf7582 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8abbf99271a142d0b6b33194845916aa/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.771241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.772594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3e4ba-a2ab-4e5e-873b-a3b60eaf7582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=8abbf99271a142d0b6b33194845916aa, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.775694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3e4ba-a2ab-4e5e-873b-a3b60eaf7582 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.777164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 407/823] 10.222.0.43 () {56 vars in 1145 bytes} [Tue Dec 14 03:03:10 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:10.783385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:10.798613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 417/824] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:10 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8abbf99271a142d0b6b33194845916aa/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:03:10.802782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbe2c3-28cd-4bfc-81e5-761a860659d5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:10.878728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:10.879429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:10.879740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:10.880017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:10.880800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:10.881823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:10.881823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:03:10.881823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:03:10.882712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d167225-9b97-4491-b762-fac1a2c67fcd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:10.924832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 408/825] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:10 2021] POST /identity/v3/endpoints => generated 346 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:03:11.661067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cf6bf-485a-4724-b3cd-ab2786cc2e7c None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.661466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cf6bf-485a-4724-b3cd-ab2786cc2e7c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.661645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cf6bf-485a-4724-b3cd-ab2786cc2e7c None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.663685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 418/826] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:11.676350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.677318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.677467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.699123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:11.700385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:11.732968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 409/827] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:11 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:11.767526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cf6bf-485a-4724-b3cd-ab2786cc2e7c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:11.786071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cf6bf-485a-4724-b3cd-ab2786cc2e7c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:11.792584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:11.793377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.793904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.794184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] PATH_INFO: `/v3/services/network` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.794864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:11.795932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:11.795932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:03:11.795932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:03:11.796954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:11.811255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 14 03:03:11.812624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 419/828] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:11 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:11.819015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:11.828458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3af088-108d-4b69-a25c-23ff18f6284f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:11.833496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:11.834149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.834432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.834711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.835460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:11.835770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:11.837387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:11.845966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 410/829] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:11 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:11.852246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:11.868657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387fb7-4418-46dc-a9e7-bf479ebb42bd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:11.873193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:11.873844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.874128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.874405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.879383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:11.879785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:11.881401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0a426-c0cc-4da8-bfeb-3b4d0fc4c181 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:11.886629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 420/830] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:11 2021] GET /identity/v3/services?type=network => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:11.892875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:11.904682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef5a6-4509-47e1-ba37-2bab791ef35b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:11.909271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305dbba-5c1a-4389-9ca5-bed2530dc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:11.909856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305dbba-5c1a-4389-9ca5-bed2530dc205 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.910144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305dbba-5c1a-4389-9ca5-bed2530dc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.910423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305dbba-5c1a-4389-9ca5-bed2530dc205 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.911747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305dbba-5c1a-4389-9ca5-bed2530dc205 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:11.913336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305dbba-5c1a-4389-9ca5-bed2530dc205 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:11.946175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 411/831] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:11 2021] POST /identity/v3/endpoints => generated 327 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:11.955639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091a345-cfa5-4535-a1b9-821570d1f73e None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.955927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091a345-cfa5-4535-a1b9-821570d1f73e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.956204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091a345-cfa5-4535-a1b9-821570d1f73e None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.958444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 421/832] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:11.964500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:11.964784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:11.965061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:11.992324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:11.993569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:12.016987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 412/833] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:11 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:12.052450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091a345-cfa5-4535-a1b9-821570d1f73e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.070190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091a345-cfa5-4535-a1b9-821570d1f73e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.078962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.080164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.080557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.080936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.081832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.084022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.104117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 14 03:03:12.105658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 422/834] 10.222.0.43 () {56 vars in 1153 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:12.112400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.130418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcfd4e-39d2-4f8b-a975-84f46637a85a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.137577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.138245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.138527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.138799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.139557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:12.139864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.141462 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2821ab-1ddd-4ec5-a696-6ec5e1b49922 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.151404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 413/835] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:12.153098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.168616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5e9c-6548-4206-96f2-71849d941d5f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.174854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.175689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.176325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.176749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.177614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:12.178068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.185335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea762-6fb6-4780-9b57-5ab67216b7de admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.191293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 423/836] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:12.508911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12047dc-8d62-4622-920b-a24ceb981952 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.509115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12047dc-8d62-4622-920b-a24ceb981952 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.509386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12047dc-8d62-4622-920b-a24ceb981952 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.511501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 414/837] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:12.517548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.517860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.518333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.541899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:12.543110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:12.553002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 424/838] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:12 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:12.579908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12047dc-8d62-4622-920b-a24ceb981952 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.594710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12047dc-8d62-4622-920b-a24ceb981952 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.599548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.600342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.600622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.600890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.614879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:12.621671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:03:12.625162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 415/839] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:12.631939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.640953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d82c-571d-40d1-baa2-5535ad4cf690 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.645706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.646357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.646636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.646949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.647732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:12.648032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.649616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.661842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 425/840] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:12.666863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.677783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ba84-e1a9-4776-9071-1244bd797f2b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.684700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.685490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.685770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.686047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.697727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.699618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.717512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:12.719000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 416/841] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:12.725533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.735231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce1881-33d1-484d-ba74-f3000623904e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.740187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.740880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.741164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.741500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.742230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:12.742532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.744348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.757406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 426/842] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:12.763368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.773854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1db94-334a-4e67-8406-db25424e7e75 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.778541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.779416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.779693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.780021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.788406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.790481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.806064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 14 03:03:12.807560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 417/843] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:12.814118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.824908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ef64-7d50-41f9-a1c8-46a078b1a64b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.829561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.830257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.830542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.830814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.831774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:12.832075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.834585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.852451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 427/844] 10.222.0.43 () {56 vars in 1170 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:12.858390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.868654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83889837-c35b-4761-8431-08b844f07fce admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.873343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.873978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.874257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.874584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.883094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.884888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.894001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 418/845] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:12.900349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.909902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1d624-1e9b-4675-876f-d90836e20aaf admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.914489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.915462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.915747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.916019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.926380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.928312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.945322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:12.946729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 428/846] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:12.952668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:12.962084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60729-3f36-401c-bf12-99bb5b35e558 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:12.966769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:12.968451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:12.968730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:12.968997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:12.969727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:12.970026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:12.971614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:12.983932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 419/847] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:12.990468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.000203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730af4-909c-450f-80e2-3de95b8465a8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.004922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.005743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.006021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.006341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.013467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.015491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.029083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:13.030574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 429/848] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:13.037230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.047333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ac777-ab24-4f93-83cb-50126e672d51 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.052042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.052739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.053020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.053297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.054137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:13.054445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.056410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b891-fe86-456e-b7a3-ec313181a2ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.069701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 420/849] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:13.075942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.087327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d98e-eff9-441e-852e-cceb82c3778c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.091963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.092653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.092932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.093259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.094109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=f9a2e0f788614fe98b7e1d430d473a55) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:13.094471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.096390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a20b2-cac3-400a-8836-0e9259d9639f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.103630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 430/850] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/role_assignments?user.id=f9a2e0f788614fe98b7e1d430d473a55&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:13.751266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8beb6-128c-4ecc-9e1c-fbf414fff656 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.751266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8beb6-128c-4ecc-9e1c-fbf414fff656 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.751266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8beb6-128c-4ecc-9e1c-fbf414fff656 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.752443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 421/851] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:13.760242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7d10-f120-429f-ac21-5d7422d4189b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.760242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7d10-f120-429f-ac21-5d7422d4189b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.760242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7d10-f120-429f-ac21-5d7422d4189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.778008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2f6d7d10-f120-429f-ac21-5d7422d4189b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:13.779217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2f6d7d10-f120-429f-ac21-5d7422d4189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:13.787760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 431/852] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:13.812122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8beb6-128c-4ecc-9e1c-fbf414fff656 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.824765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8beb6-128c-4ecc-9e1c-fbf414fff656 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.829382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.830380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.830871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.831407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.842405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:13.850082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:13.851838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 422/853] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:13.857915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d27a4-1332-464b-9ec6-5772ee8f7506 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.858342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d27a4-1332-464b-9ec6-5772ee8f7506 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.858670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.858784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d27a4-1332-464b-9ec6-5772ee8f7506 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.861090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 432/854] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:13.866845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.867160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.867514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.870458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fd39-bfe8-415f-a200-4221cf78863e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.875342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.876156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.876594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.876994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.877885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:13.878343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.880160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.888853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:13.890035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 423/855] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:13.895097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:13.896922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.911558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147665ee-bbdb-49cd-b936-9ec0676d5e2c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.912141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 433/856] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:13.912519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.913292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.913576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.913852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.924732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.926664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.929002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.938205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48291009-ddd4-46af-b336-78d62b28cad7 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.942992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.944086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.944586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.945062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.945941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.946124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:13.952813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.952931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 424/857] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:13.953781 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.965175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514cbe1-1599-41e3-8811-1626d9ec93bb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.967339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 14 03:03:13.974572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:13.974572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:13.974572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:13.974572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:13.974891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:13.974891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:13.974891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:13.975704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 434/858] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:13.976692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:13.987131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c900-a6cb-4928-ba58-5501808337b9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:13.992679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 425/859] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:13.993717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.002302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.003083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.003354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.003624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.004414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:14.004750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.006450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.006712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefdd44-b2c8-49d6-a947-7ada5c4ab566 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.011524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.011664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 435/860] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:14.012689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.013190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.013669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.018268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.024749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.026998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.029086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d737-6fbc-4f35-9769-20277ae900d7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.034627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.035361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.035642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.036605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.037333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:14.037637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.039318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.044186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 14 03:03:14.044402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 436/861] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:14.045725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 426/862] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:13 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:14.052473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.063238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2cd93-4050-450a-88db-077d3dcdaf26 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.068249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.069068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.069453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.069799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.070831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:14.071228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.073322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.094188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 437/863] 10.222.0.43 () {56 vars in 1156 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:14.101055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.113387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2af0e-5256-4e78-ab05-a6e4c833ffd5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.118973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.120106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.120586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.121120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.131113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.133283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.143926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 427/864] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:14.151278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.161917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da730d-5c95-4243-aba5-ad80912bf700 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.167012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.168109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.168638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.169108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.180909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.183285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.202977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:14.204982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 438/865] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:14.212167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.222040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d15549-aacc-4543-a87d-571c079e0b89 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.227876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.228866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.229363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.229833 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.230784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:14.231347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.233147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.248255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 428/866] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:14.255301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.265998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbdf87-1ea2-4fbc-ac09-a0cca49b46e2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.272588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.273699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.274158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.274483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.284303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.286330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.301309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:14.302801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 439/867] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:14.308975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.319376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01521da-fe6c-4399-9393-ac9945301a45 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.323944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.324587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.324878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.325130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.325970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:14.326242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.328075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e8254-b199-44df-8689-d7bbdcbaaabf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.340892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 429/868] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:14.347415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.358291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3d84-2072-43c2-b633-c528ce4661cc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.363487 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.364230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.364483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.364762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.365649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8abbf99271a142d0b6b33194845916aa) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:14.365959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.367998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8c95-4163-4aaf-8b12-eb6977bdf602 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.375254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 440/869] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:14 2021] GET /identity/v3/role_assignments?user.id=8abbf99271a142d0b6b33194845916aa&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:14.805132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56269e-dd42-4a27-a6d5-08cd79aeed32 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.805812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56269e-dd42-4a27-a6d5-08cd79aeed32 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.805812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56269e-dd42-4a27-a6d5-08cd79aeed32 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.807692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 430/870] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:14.813578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f14b2-8502-4d35-89ed-fbd57d740c75 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.814038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f14b2-8502-4d35-89ed-fbd57d740c75 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.814224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f14b2-8502-4d35-89ed-fbd57d740c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.832469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-417f14b2-8502-4d35-89ed-fbd57d740c75 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:14.834204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-417f14b2-8502-4d35-89ed-fbd57d740c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:14.842296 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 441/871] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:14 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:14.866047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56269e-dd42-4a27-a6d5-08cd79aeed32 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:14.878323 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56269e-dd42-4a27-a6d5-08cd79aeed32 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:14.883544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:14.884448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:14.884920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:14.885408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:14.886315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:14.887557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:14.887557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:03:14.887557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:03:14.888725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1486f-d752-408c-b74a-45b56cfdcf40 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:14.907175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 431/872] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:14 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:15.623676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b05da-ce40-444d-9946-810460c71a2d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.624045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b05da-ce40-444d-9946-810460c71a2d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.624233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b05da-ce40-444d-9946-810460c71a2d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.626265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 442/873] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:15.632509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.632790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.633057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.652892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:15.659877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:15.681993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 432/874] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:15 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:15.706433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b05da-ce40-444d-9946-810460c71a2d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.719859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b05da-ce40-444d-9946-810460c71a2d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.724547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.725601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.726079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.726563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.737196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:15.745027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 14 03:03:15.746787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 443/875] 10.222.0.43 () {56 vars in 1141 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:15.753181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.762871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c80f-e46e-463f-9afb-0603761d80d3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.767689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.768570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.769074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.769564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.771144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:15.771666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:15.773446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:15.783015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 433/876] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:15.788732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.798463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cd17-8c98-43fb-8038-db6e30358bc4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.803030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.803883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.804167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.804442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.815543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:15.817978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:15.834752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:15.836302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 444/877] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:15.842316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.852114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc033-d058-4558-b55a-cbde1f397a14 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.856707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.857414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.857698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.857975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.858754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:15.859088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:15.860838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:15.873616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 434/878] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:15.880206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.890135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a7caf-552c-49c8-97c9-7a4cd3c83efd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.894889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.896334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.896616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.896887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.905284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:15.907373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:15.921469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 14 03:03:15.922901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 445/879] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:15.929202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.939141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a955d-337d-47ec-99e2-70418d009460 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.944412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.945115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.945397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.945675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.946570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:15.946877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:15.948818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:15.967202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 435/880] 10.222.0.43 () {56 vars in 1170 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:15.973604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:15.983647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1f89-e39a-486d-9d9c-22a7c0eb40a0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:15.988592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:15.989795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:15.990081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:15.990355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:15.998647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.000560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.010632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 446/881] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:15 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:16.017043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.026993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1056906-cb9b-40be-abb8-1337f413718f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.031729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.032595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.032877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.033154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.043959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.045843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.063793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:16.065340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 436/882] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:16.072008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.081531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574f45-29e7-4763-9390-45856ac01a08 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.086583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.087329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.087612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.087943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.088699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:16.089061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.090766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.105134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 447/883] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:16.111129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.122520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c09ff-ff37-43c4-b87e-64878f567f2c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.127628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.128547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.128828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.129103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.137794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.139711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.153898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:16.155450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 437/884] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:16.162180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.172210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae35bd-d457-45d9-883b-20e41500e77b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.176933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.177628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.177909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.178185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.179067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:16.179397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.181337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69780f77-2e10-41aa-b9f0-ae7a111f0143 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.194058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 448/885] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:16.200400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.211752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3547ac-6bdc-49e6-a72f-b027b0f62bac admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.216434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.217066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.217393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.217672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.218883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] RBAC: Adding query filter params (role.id=d346ddef828944bfad57bec70ad88927, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=f9a2e0f788614fe98b7e1d430d473a55) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:16.219225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.221147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6680f9-6aba-44c2-8d54-5672499a914e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.228550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 438/886] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/role_assignments?user.id=f9a2e0f788614fe98b7e1d430d473a55&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=d346ddef828944bfad57bec70ad88927 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:16.493506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94776b-7acf-45a1-bc05-b9e111aef34a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.493877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94776b-7acf-45a1-bc05-b9e111aef34a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.494044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94776b-7acf-45a1-bc05-b9e111aef34a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.496019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 449/887] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:16.501744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ecaeb-bf68-4038-89fc-c61f8dc24c6e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.502030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ecaeb-bf68-4038-89fc-c61f8dc24c6e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.502309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ecaeb-bf68-4038-89fc-c61f8dc24c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.519925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c27ecaeb-bf68-4038-89fc-c61f8dc24c6e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:16.521147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c27ecaeb-bf68-4038-89fc-c61f8dc24c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:16.529254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 439/888] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:16 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:16.553410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94776b-7acf-45a1-bc05-b9e111aef34a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.565730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94776b-7acf-45a1-bc05-b9e111aef34a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.570301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f04939-4809-4298-a318-c83e6614c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.570934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04939-4809-4298-a318-c83e6614c685 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.571238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04939-4809-4298-a318-c83e6614c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.571563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04939-4809-4298-a318-c83e6614c685 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.572301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f04939-4809-4298-a318-c83e6614c685 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.573942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f04939-4809-4298-a318-c83e6614c685 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.591114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 450/889] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:16 2021] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:16.821255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51453c-10cc-4a1f-a86c-189959cacd2d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.821610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51453c-10cc-4a1f-a86c-189959cacd2d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.821813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51453c-10cc-4a1f-a86c-189959cacd2d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.823913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 440/890] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:16.830569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.830569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.830569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.849959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:16.851465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:16.869603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 451/891] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:16 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:16.893119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51453c-10cc-4a1f-a86c-189959cacd2d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.905894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51453c-10cc-4a1f-a86c-189959cacd2d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.910484 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.911492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.911951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.912394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.913247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.915025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.927461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 14 03:03:16.929159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 441/892] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:16.935937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.945846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4bf01-83e9-4efa-9120-682f26bdb8cd None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.950690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.951594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.952018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.952460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.953321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:16.953816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.955609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c638c-e256-4ef6-ad17-c45d0ff5209d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.961180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 452/893] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:16.967578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:16.978328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd63b4-edb2-4a1c-8e33-a036ad6cd93f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:16.983776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:16.984750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:16.985243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:16.985663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:16.986594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:16.987066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:16.989742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c122-5985-4a80-8a6b-0712d97041fb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:16.995834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 442/894] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:16 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:17.400733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9222-a3bc-4e26-a6ce-6dc15aa55420 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.401137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9222-a3bc-4e26-a6ce-6dc15aa55420 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.401345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9222-a3bc-4e26-a6ce-6dc15aa55420 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.403461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 453/895] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:17.409503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.409789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.410064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.428969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:17.430271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:17.443145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 443/896] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:17.461412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a9222-a3bc-4e26-a6ce-6dc15aa55420 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:17.474027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a9222-a3bc-4e26-a6ce-6dc15aa55420 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:17.478390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:17.479212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.479486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.479752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.480413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:17.481995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:17.494222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 14 03:03:17.499154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 454/897] 10.222.0.43 () {56 vars in 1153 bytes} [Tue Dec 14 03:03:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:17.502030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:17.511093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d174be-ca8c-4466-a47e-0f0da89a88d5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:17.515615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:17.516249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.516525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.516798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.517524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:17.517809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:17.519385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:17.531240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 444/898] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:17.533450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:17.544871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32d1b9-bfc8-4bf0-8a4d-914ceac930ec admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:17.549610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:17.550313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.550593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.550881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.551795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:17.552102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:17.553742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:17.559311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 455/899] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:17 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:17.568291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:17.581950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adced0-8966-4d90-b41e-2c92e1befd0a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:17.587201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:17.588131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.588542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.588944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.590177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] RBAC: Adding query filter params (interface=public, service_id=e5d56af3d68f4af386cfdf851341f9d3, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:17.590637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:17.592221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:17.592221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:03:17.592221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:03:17.593587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e7f2a-80b1-47d2-ae4e-0bcd0bd7d177 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:17.607173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 445/900] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:17 2021] GET /identity/v3/endpoints?service_id=e5d56af3d68f4af386cfdf851341f9d3&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:17.611064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:17.623855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1abe5-84b3-4561-bbed-a24e93795390 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:17.629245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f235c9e-3c9d-4d1a-90bc-1dd9c3c07659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:17.630849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f235c9e-3c9d-4d1a-90bc-1dd9c3c07659 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:17.631371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f235c9e-3c9d-4d1a-90bc-1dd9c3c07659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:17.631779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f235c9e-3c9d-4d1a-90bc-1dd9c3c07659 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:17.632896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f235c9e-3c9d-4d1a-90bc-1dd9c3c07659 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:17.635615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f235c9e-3c9d-4d1a-90bc-1dd9c3c07659 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:17.647176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 456/901] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:17 2021] GET /identity/v3/services => generated 1268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:03:18.640592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f4ff-8550-40ae-af7c-9e8d151567f1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.641326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f4ff-8550-40ae-af7c-9e8d151567f1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.641326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f4ff-8550-40ae-af7c-9e8d151567f1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.643420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 446/902] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:18.650725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.651406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.651406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.680595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:18.682097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:18.690360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 457/903] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:18 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:18.715496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f4ff-8550-40ae-af7c-9e8d151567f1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.728425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f4ff-8550-40ae-af7c-9e8d151567f1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.733335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.734332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.734789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.735280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.747354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:18.755424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 14 03:03:18.757143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 447/904] 10.222.0.43 () {56 vars in 1141 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:18.763278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.773008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f7c91-fd08-40fa-a12a-451e51c82491 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.777604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.778256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.778537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.778806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.779595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:18.779896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:18.781487 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:18.790845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 458/905] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:18.797113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.807347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98254574-ba1e-4913-8660-b1cdc5dab555 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.811936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.812713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.812995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.813268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.824425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:18.826250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:18.843862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:18.845337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 448/906] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:18.851503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.861270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd485-1db8-41aa-b2bb-22058801170a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.866137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.866776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.867065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.867351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.868077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:18.868377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:18.869952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:18.882810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 459/907] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:18.888826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.899333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ddbe-c4f6-45ab-b637-d2f2968afc1b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.903850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.904642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.904919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.905189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.912739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:18.914735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:18.929612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 14 03:03:18.935145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 449/908] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:18.937212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.947809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a010c8b-56a0-42c8-9bdc-0e7c894e19c2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.952381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.953028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.953306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.953580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:18.954420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:18.954724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:18.956589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:18.974981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 460/909] 10.222.0.43 () {56 vars in 1170 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:18.980960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:18.991543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56b9f6-13af-463e-b1e0-87a576053014 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:18.996080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:18.996853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:18.997130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:18.997403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.008504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.010339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.029937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:19.031446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 450/910] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:19.037504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.047469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041bb7-a83f-46cd-9c36-b19ed2774676 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.052628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.053282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.053561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.053837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.054581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:19.054883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.056552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b111e-0a86-4900-9673-22312e8601f7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.069673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 461/911] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:19.079196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.079437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb602-07e7-4266-a415-e8bc56c6052a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.079437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb602-07e7-4266-a415-e8bc56c6052a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.079437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb602-07e7-4266-a415-e8bc56c6052a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.080082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 462/912] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:19.086070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.086397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b770-227e-403b-aba9-49103d024ddc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.086836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.087505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.091259 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.092066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.092347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.092619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.101648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.104593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.108531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:19.110019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:19.123127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:19.123127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 451/913] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:19.123577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 463/914] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:19 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:19.128102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.139939 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64761182-5fa7-4dfe-bac5-4696f1c47da9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.144030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.144724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.145402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.145676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.145942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.146725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:19.147122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.148850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.157444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5408c-79a2-4025-aacc-1da1de6e577d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.162506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.163627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.164110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.164630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.165534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.166114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 452/915] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:19.167425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.168230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.177180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397181e-b8d5-401e-a78e-7b51a3b5a250 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.181279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 14 03:03:19.181747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.182598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.182930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.183232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/f9a2e0f788614fe98b7e1d430d473a55/roles/d346ddef828944bfad57bec70ad88927` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.188850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=f9a2e0f788614fe98b7e1d430d473a55, role_id=d346ddef828944bfad57bec70ad88927)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.188850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.189411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 464/916] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:19.190409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.203803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b55f-8175-4cf4-9dc5-6b74b5bf1fcd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.209444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 453/917] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:19 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/f9a2e0f788614fe98b7e1d430d473a55/roles/d346ddef828944bfad57bec70ad88927 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:03:19.280211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.280967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.281299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.281573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.282348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:19.282652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.284326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.290150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 465/918] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:19.296244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.309026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd710f91-0ee4-4844-8fa3-6a1cde29923f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.314701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.315813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.316300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.316850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.318403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:19.319028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.321016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.327412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 454/919] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:19.334320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.345388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2a47-fd3c-422b-aa5b-b1a80a287bc3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.350968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.352079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.352563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.353081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.354143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] RBAC: Adding query filter params (interface=public, service_id=6d187277bdb048ecae79b20ec2328f40, region_id=RegionOne) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:19.354712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.356683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e08bb6-a260-435c-bbcf-8eb2c2b7802f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.363641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 466/920] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/endpoints?service_id=6d187277bdb048ecae79b20ec2328f40&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:19.370650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.382153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae98896-399c-4c09-8632-db9ec58d12d8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.387727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c27903-03d3-47da-be50-2e5a7d9f159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.388768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c27903-03d3-47da-be50-2e5a7d9f159d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.389328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c27903-03d3-47da-be50-2e5a7d9f159d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.389802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c27903-03d3-47da-be50-2e5a7d9f159d admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.390760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c27903-03d3-47da-be50-2e5a7d9f159d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.392779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c27903-03d3-47da-be50-2e5a7d9f159d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.400479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 455/921] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:19 2021] GET /identity/v3/services => generated 1268 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:03:19.532542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3a07-1823-4ce7-9312-9cb178f3338e None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.532834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3a07-1823-4ce7-9312-9cb178f3338e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.533013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3a07-1823-4ce7-9312-9cb178f3338e None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.535173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 467/922] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:19.542072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13e87-5441-4bc7-86e9-2ba14629e446 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.542362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13e87-5441-4bc7-86e9-2ba14629e446 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.542689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13e87-5441-4bc7-86e9-2ba14629e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.561643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b6b13e87-5441-4bc7-86e9-2ba14629e446 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:19.562885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b6b13e87-5441-4bc7-86e9-2ba14629e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:19.571286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 456/923] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:19 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:19.594871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed3a07-1823-4ce7-9312-9cb178f3338e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:19.608313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed3a07-1823-4ce7-9312-9cb178f3338e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:19.613278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e5f7-6149-42b9-97fc-e1ff49572f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:19.614576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e5f7-6149-42b9-97fc-e1ff49572f56 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:19.614902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e5f7-6149-42b9-97fc-e1ff49572f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:19.615207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e5f7-6149-42b9-97fc-e1ff49572f56 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:19.616019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07e5f7-6149-42b9-97fc-e1ff49572f56 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:19.617731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07e5f7-6149-42b9-97fc-e1ff49572f56 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:19.638954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 468/924] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:19 2021] POST /identity/v3/services => generated 241 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:20.044308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2bad-f9e0-4473-9c7d-93fed569b819 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:20.044823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2bad-f9e0-4473-9c7d-93fed569b819 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:20.044823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2bad-f9e0-4473-9c7d-93fed569b819 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:20.046832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 457/925] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:20.053289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:20.053698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:20.053880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:20.072043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:20.073223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:20.089544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 469/926] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:20 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:20.114231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2bad-f9e0-4473-9c7d-93fed569b819 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:20.126429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2bad-f9e0-4473-9c7d-93fed569b819 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:20.131349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:20.132133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:20.132410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:20.132683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:20.133343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:20.134921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:20.146156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 14 03:03:20.147627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 458/927] 10.222.0.43 () {56 vars in 1153 bytes} [Tue Dec 14 03:03:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:20.153997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:20.163496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39667ad8-edff-4bfa-94b3-6b8f6e6cc3d5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:20.168020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:20.168661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:20.168940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:20.169212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:20.169927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:20.170230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:20.171874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:20.177532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 470/928] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:20.183566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:20.193193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03da1c-a7aa-4e89-9a21-0970e695083f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:20.197703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:20.198337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:20.198613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:20.198884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:20.199629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:20.199929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:20.201498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788c78-fcd4-4ced-8e39-39637073c505 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:20.206636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 459/929] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:20.212722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:20.222868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28dbee-be8c-4be3-a504-5cf060e253b7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:20.228091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:20.228775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:20.229106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:20.229383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:20.230194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:20.231275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:20.231275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:03:20.231275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:03:20.232262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9612ee-2003-49f8-b8d1-5eaf04f5b829 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:20.255247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 471/930] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:20 2021] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:21.651105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a80cdd-9458-462c-a63c-5f3dfb0b90ab None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.652152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a80cdd-9458-462c-a63c-5f3dfb0b90ab None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.652670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a80cdd-9458-462c-a63c-5f3dfb0b90ab None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.660962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 460/931] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:21 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:21.667166 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dac53-bc38-4426-822e-98524606df04 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.667673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dac53-bc38-4426-822e-98524606df04 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.667773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dac53-bc38-4426-822e-98524606df04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.689454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-213dac53-bc38-4426-822e-98524606df04 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:21.690943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-213dac53-bc38-4426-822e-98524606df04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:21.709370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 472/932] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:21 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:21.732657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a80cdd-9458-462c-a63c-5f3dfb0b90ab None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.745714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a80cdd-9458-462c-a63c-5f3dfb0b90ab None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.750480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.751530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.752103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.752583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.764880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:21.772958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 14 03:03:21.774645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 461/933] 10.222.0.43 () {56 vars in 1141 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:21.780906 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dac53-bc38-4426-822e-98524606df04 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.789795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dac53-bc38-4426-822e-98524606df04 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.794427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.795092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.795427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.795764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.796521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:21.796825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:21.798931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:21.815003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 473/934] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:21.816356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.828420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc559f-7fea-4558-957f-70f7b8a8d117 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.833876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.834878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.835404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.835869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.846404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:21.848588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:21.865445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b9131b98-a024-45fe-8e7b-30226fb8d96f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:21.871176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 462/935] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:21.873550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.884168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41117a-f6d3-46e4-b78f-b98df3218aa7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.888937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.889810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.890282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.890744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.891706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:21.892218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:21.894000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:21.897813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4e267-653b-4deb-9849-9c441fdbaf15 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.898110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4e267-653b-4deb-9849-9c441fdbaf15 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.898390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4e267-653b-4deb-9849-9c441fdbaf15 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.900442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 463/936] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:21.905714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518711d5-eaf7-4e63-9754-460280013710 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.905948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518711d5-eaf7-4e63-9754-460280013710 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.906225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518711d5-eaf7-4e63-9754-460280013710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.915136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 474/937] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:21.917155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.925690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-518711d5-eaf7-4e63-9754-460280013710 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:21.926921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-518711d5-eaf7-4e63-9754-460280013710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:21.927796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3a63-7219-473c-830c-186662895b47 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.932770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.934063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.934544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.935005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.935903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 464/938] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:21 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:21.944025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:21.946360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:21.961226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518711d5-eaf7-4e63-9754-460280013710 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.961644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 14 03:03:21.968253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 475/939] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:21.969644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:21.970451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518711d5-eaf7-4e63-9754-460280013710 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.975281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.976078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.976361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.976637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.977309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:21.978905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:21.981670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51120daf-0c7e-418e-b51d-e20485a5097e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:21.986457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:21.987355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:21.988094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:21.988551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:21.990100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:21.990591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:21.991054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 14 03:03:21.992930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:21.998212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 465/940] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:21.999269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.009557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb3c1-3d5b-43b3-b17a-949f79e16248 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.015091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.015415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.015776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.016057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.016785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.017093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.018629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 476/941] 10.222.0.43 () {56 vars in 1170 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:22.018757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.020801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.025384 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 466/942] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:21 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:22.031006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2c036-3254-4953-a704-897aac5ef71b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.031309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.036502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.037245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.037633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.038005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.042576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee98814-8ddc-4b18-ad4f-61c290f675fc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.046778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.047220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.047870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.048152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.048427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.049068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.049183 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.049434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.051299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.062342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 477/944] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:03:22.062616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 467/944] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:22.064957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.066772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.077627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383a3e5-57ff-4c6b-a651-0692353ceb28 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.078032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4860034-44d3-41c3-acb8-a6f06421ec60 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.082882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.083696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.083981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.084259 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.084700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb510a-2e31-495b-b4f1-cd0c96c0b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.085338 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb510a-2e31-495b-b4f1-cd0c96c0b32b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.085613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb510a-2e31-495b-b4f1-cd0c96c0b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.085878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb510a-2e31-495b-b4f1-cd0c96c0b32b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.086628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb510a-2e31-495b-b4f1-cd0c96c0b32b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.088232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb510a-2e31-495b-b4f1-cd0c96c0b32b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.096024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.097840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.119082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 478/945] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:22 2021] POST /identity/v3/endpoints => generated 346 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:22.119082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296b29-f44a-4592-b16a-22a3017d19f0 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.119082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296b29-f44a-4592-b16a-22a3017d19f0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.119082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296b29-f44a-4592-b16a-22a3017d19f0 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.119082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 479/946] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:22.119603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:22.119603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 468/947] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:22.119760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e048-9635-4762-8b18-6100ad89623c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.120117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e048-9635-4762-8b18-6100ad89623c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.120412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e048-9635-4762-8b18-6100ad89623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.125240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.135934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168cf06-d44f-462a-95ec-366a1a9e5b61 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.143611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8193e048-9635-4762-8b18-6100ad89623c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:22.147318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8193e048-9635-4762-8b18-6100ad89623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:22.158241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.158884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.159228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.159526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.160282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.161185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.167629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.167823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 480/948] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:22.188872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e048-9635-4762-8b18-6100ad89623c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.190778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 469/949] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:22.197869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.200312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e048-9635-4762-8b18-6100ad89623c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.206475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.208227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.208700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.208802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd388a1f-ed0b-4def-aceb-afaa767540a6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.209254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.210200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.212480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.214644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.215664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.216018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.216361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.224827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.226903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.227550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 14 03:03:22.235062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 481/950] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:22.237219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.243788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:22.245506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 470/951] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:22.248271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98d364-b60f-4431-acdb-947406348c6b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.252329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.253982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.255015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.255786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.256448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.258066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.258888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.261706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.265449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a55e2-e31d-47d3-a3ad-52d742c6e66d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.274511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 482/952] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:22.276329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.277325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.278131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.278461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.278810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.279792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.280176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.282247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.289312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117368a-e99c-4625-9e31-3572f7a9a897 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.295668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.296626 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.297073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.297533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.299269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.299925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.303003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.305463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 471/953] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:22.313954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.314235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 483/954] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:22.318226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.326082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4cc63-0c2d-4b98-96e8-cb2735d87541 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.331254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.332131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.333005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.333359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3d4c-e146-4931-a07b-f97121be90ed admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.333472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.334486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] RBAC: Adding query filter params (role.id=d346ddef828944bfad57bec70ad88927, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=f9a2e0f788614fe98b7e1d430d473a55) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.334890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.337350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.339139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.340361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.340781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.341739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.343033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] RBAC: Adding query filter params (interface=public, service_id=40d253afc9824e7b842a708c8982d494, region_id=RegionOne) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.343509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.345082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 472/955] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/role_assignments?user.id=f9a2e0f788614fe98b7e1d430d473a55&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=d346ddef828944bfad57bec70ad88927 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:22.346625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513ff61-ab7a-4f2e-b3fd-ef31345a5824 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.358544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 484/956] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/endpoints?service_id=40d253afc9824e7b842a708c8982d494&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:22.360382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.370829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a83ede-bacd-4bb6-b452-dbfecc547590 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.375688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0189f4-13b6-41a1-bd0d-27370b0f60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.376372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0189f4-13b6-41a1-bd0d-27370b0f60c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.376650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0189f4-13b6-41a1-bd0d-27370b0f60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.376922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0189f4-13b6-41a1-bd0d-27370b0f60c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.377626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0189f4-13b6-41a1-bd0d-27370b0f60c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.379875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0189f4-13b6-41a1-bd0d-27370b0f60c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.386900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 473/957] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:03:22.680020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921e92-9f43-41b7-900f-b6bf38a66e5a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.680526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921e92-9f43-41b7-900f-b6bf38a66e5a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.680610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921e92-9f43-41b7-900f-b6bf38a66e5a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.682321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 485/958] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:22.688232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.688646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.688780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.706693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:22.708453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:22.716477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 474/959] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:22.740223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921e92-9f43-41b7-900f-b6bf38a66e5a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.752748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921e92-9f43-41b7-900f-b6bf38a66e5a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.758267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.759139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.759449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.759784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.760445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.762078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.773150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 14 03:03:22.774589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 486/960] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:22.780794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.789684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491fedd-5fda-498c-81b2-e8e1f0c92970 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.794240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.794879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.795199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.795475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.796189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.796492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.798061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962e249-d772-43a7-b57a-0180d8bd7bf6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.803601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 475/961] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:22.809583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:22.821224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671eef-d675-4a58-8e29-cd06051bf87a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:22.825829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:22.826462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:22.826741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:22.827013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:22.827758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:22.828058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:22.829637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dace-8200-4123-8922-c2ff68db16f3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:22.834464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 487/962] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:22 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:24.590598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306834f9-b21f-4b15-8b27-ae2177e407e5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.591151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306834f9-b21f-4b15-8b27-ae2177e407e5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.591151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306834f9-b21f-4b15-8b27-ae2177e407e5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.593186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 476/963] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:24.599371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.599761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.599939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.618607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:24.619814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:24.627804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 488/964] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:24 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:24.652189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306834f9-b21f-4b15-8b27-ae2177e407e5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.670194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306834f9-b21f-4b15-8b27-ae2177e407e5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.675677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.676897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.677174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.677444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.678160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.680076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.681448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.common [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 14 03:03:24.700725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.sql.core [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 14 03:03:24.700725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 14 03:03:24.700725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [parameters: {'id': 'f0c842fc83d042bea08d104d6a1245a3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 14 03:03:24.700725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 14 03:03:24.707358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0c842fc83d042bea08d104d6a1245a3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0c842fc83d042bea08d104d6a1245a3. Dec 14 03:03:24.709137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 477/965] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Dec 14 03:03:24 2021] POST /identity/v3/projects => generated 262 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:24.715806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.726306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e7af8-cf5d-40c4-8cdf-114875c489ea None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.731030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.731874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.732156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.732433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.740673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.742761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.756285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-798bc7a7-ffb7-44b4-96a0-9058c31357aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:24.757882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 489/966] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:24.764298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.775437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443abe4f-83c7-4e50-8a04-e8d573486386 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.780157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.780831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.781113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.781388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.782167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:24.782475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.784662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2dde5-1567-45ff-a0d6-73d724f99cce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.802829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7ea25-f442-4c38-addb-740b739ed919 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.803131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7ea25-f442-4c38-addb-740b739ed919 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.804216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7ea25-f442-4c38-addb-740b739ed919 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.806447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 490/967] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:24.807750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d77d-71ce-4406-ae2f-f777a1c9f51b None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.808034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d77d-71ce-4406-ae2f-f777a1c9f51b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.808338 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d77d-71ce-4406-ae2f-f777a1c9f51b None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.810045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 491/968] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:24.811034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 478/969] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:24.813314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.813604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.813877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.816670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.816959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.817236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.837767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:24.838976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:24.846344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:24.847364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 492/970] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:24 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:24.849059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:24.863083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 479/971] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:24 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:24.871630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.881278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1534194-86ff-458a-a329-e3d299ffb87a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.886080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.886885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.887198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.887467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] PATH_INFO: `/v3/services/image` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.888231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.889439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.889853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.900260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739956-4393-43d1-b90a-3b3e8bab2c4f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.901390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 14 03:03:24.905334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.906279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.906683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.907069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.907858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.908532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 493/972] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:24.909689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.909856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.921456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc563-b0c9-4f98-b713-ee5c645601ba admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.922434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 14 03:03:24.924042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 480/973] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:24.931123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.933545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.934281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.934629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.934970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.935803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] RBAC: Adding query filter params (name=image) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:24.936180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.938765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.941483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59c14a-31be-4082-bad8-472f9f8c01a2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.945233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 494/974] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/services?name=image => generated 122 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:24.948795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.949524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.949861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.950446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.951016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:24.951405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.951631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.953280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.960609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 481/975] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:24.962150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ed3b-6719-4935-953c-d78e0e0ae3dc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.967327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:24.970103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.970917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.971317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.971688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.972577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:24.973578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.975431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.979110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732074e7-bfd0-49b7-a9d5-239f9c930e44 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:24.983153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 495/976] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/services?type=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:24.983908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:24.984592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:24.984876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:24.985150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:24.985889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:24.986189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:24.988158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00490ed-6cc1-4255-88c1-5af971289568 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:24.995001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 482/977] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:25.001549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:25.012123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8b4f-2a85-49b8-9d99-3629ff2c7960 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:25.017059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbcfe-aebf-4c6e-a91b-da233d5afe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:25.017728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbcfe-aebf-4c6e-a91b-da233d5afe1d admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:25.018010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbcfe-aebf-4c6e-a91b-da233d5afe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:25.018285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbcfe-aebf-4c6e-a91b-da233d5afe1d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:25.019097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbcfe-aebf-4c6e-a91b-da233d5afe1d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:25.021306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbcfe-aebf-4c6e-a91b-da233d5afe1d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:25.044731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 496/978] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:25 2021] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:25.213755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb17c6c-acd5-4183-98ef-9198f2060721 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:25.213957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb17c6c-acd5-4183-98ef-9198f2060721 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:25.214217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb17c6c-acd5-4183-98ef-9198f2060721 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:25.216538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 483/979] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:25.222995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde5ee6-4719-48f1-ba1b-6f1482f4bedb None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:25.223356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde5ee6-4719-48f1-ba1b-6f1482f4bedb None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:25.223586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde5ee6-4719-48f1-ba1b-6f1482f4bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:25.243871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0bde5ee6-4719-48f1-ba1b-6f1482f4bedb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:25.245088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0bde5ee6-4719-48f1-ba1b-6f1482f4bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:25.263651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 497/980] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:25 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:25.287399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb17c6c-acd5-4183-98ef-9198f2060721 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:25.300970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb17c6c-acd5-4183-98ef-9198f2060721 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:25.306928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed33eb7-79f0-4b5b-8942-6fc2eb45f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:25.307607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33eb7-79f0-4b5b-8942-6fc2eb45f175 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:25.307888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33eb7-79f0-4b5b-8942-6fc2eb45f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:25.308159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33eb7-79f0-4b5b-8942-6fc2eb45f175 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:25.308883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed33eb7-79f0-4b5b-8942-6fc2eb45f175 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:25.310457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed33eb7-79f0-4b5b-8942-6fc2eb45f175 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:25.325937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 484/981] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:25 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:27.274740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cd05-4d05-4893-a20e-6f5c3f8b05bf None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.275755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cd05-4d05-4893-a20e-6f5c3f8b05bf None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.276231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cd05-4d05-4893-a20e-6f5c3f8b05bf None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.278442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 498/982] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:27.284398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abbcf6-fed7-42b4-bc53-7acddc9fe287 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.285212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abbcf6-fed7-42b4-bc53-7acddc9fe287 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.286287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abbcf6-fed7-42b4-bc53-7acddc9fe287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.306189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-10abbcf6-fed7-42b4-bc53-7acddc9fe287 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:27.308316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-10abbcf6-fed7-42b4-bc53-7acddc9fe287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:27.327702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 485/983] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:27 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:27.352866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95cd05-4d05-4893-a20e-6f5c3f8b05bf None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.366448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95cd05-4d05-4893-a20e-6f5c3f8b05bf None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.371220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.372091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.372587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.373070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.374000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.376059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.377559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.common [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 14 03:03:27.392635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.sql.core [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 14 03:03:27.392635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 14 03:03:27.392635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [parameters: {'user_id': '2544b52d99cb4b15a25a7bbffd121dc7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 14 03:03:27.392635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79278) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 14 03:03:27.405125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92768-fd21-4941-b733-043dc464edf8 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.405408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92768-fd21-4941-b733-043dc464edf8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.405687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92768-fd21-4941-b733-043dc464edf8 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.408688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 14 03:03:27.409018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 486/984] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:27.410759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 499/985] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:03:27 2021] POST /identity/v3/users => generated 160 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:27.415062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.415062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.415062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.417976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.429960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1476cb-7f83-4733-a7db-90124410165d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.436916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.437574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:27.438224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.438723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.438914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:27.439395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.449406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.451907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.452678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 487/986] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:27 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:27.468068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 14 03:03:27.469562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 500/987] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:27.474095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.476061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.483726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0586aa2-558a-41cc-8e76-709db1e67380 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.486368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef70b5-895d-4e45-91cd-24f9b6bf4dc5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.489365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eca84-2a1a-4ef8-9fc4-86f8b5649360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.490018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eca84-2a1a-4ef8-9fc4-86f8b5649360 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.490289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eca84-2a1a-4ef8-9fc4-86f8b5649360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.490570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eca84-2a1a-4ef8-9fc4-86f8b5649360 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.491313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eca84-2a1a-4ef8-9fc4-86f8b5649360 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.493147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eca84-2a1a-4ef8-9fc4-86f8b5649360 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.493428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.494288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.494759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.495264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.496263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.496755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.498953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.511115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 488/988] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:27 2021] POST /identity/v3/services => generated 242 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:27.512861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ce5b3-0df6-4508-a6ba-f41e28e59910 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.513286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ce5b3-0df6-4508-a6ba-f41e28e59910 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.513738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ce5b3-0df6-4508-a6ba-f41e28e59910 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.516152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 489/989] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:27.523405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.523925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.524349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.544024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:27.545477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:27.546277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 501/990] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:27.571095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 490/991] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:27.590584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.602131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877b75-262d-4903-bbb0-fa16cc411dd0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.607345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.608471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.608907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.609327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.610174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.612082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.624982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 14 03:03:27.626828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 502/992] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:27.634469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.644409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf5bd1-282e-41d7-8840-49561674982e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.650290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.651311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.651744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.652164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.653061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.653520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.655894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.662224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 491/993] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:27.668803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.679219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af245-46de-4b10-a63c-159b08541c48 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.684103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.684770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.685051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.685325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.686063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.686376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.688085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc88b9-80f3-4c42-8a74-558c3fe6c4cf admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.694948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 503/994] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:27.701853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.712997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b65ca-2138-425e-b722-961621ba2eb0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.717926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.718588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.718868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.719175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.719998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] RBAC: Adding query filter params (interface=admin, service_id=40d253afc9824e7b842a708c8982d494, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.720304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.722265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78931c8-aa41-425c-af7d-d954d4aebd0c None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.722543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78931c8-aa41-425c-af7d-d954d4aebd0c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.722923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78931c8-aa41-425c-af7d-d954d4aebd0c None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.724622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.725111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 504/995] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:27.733053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.733695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.734191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.736395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 492/996] 10.222.0.43 () {56 vars in 1270 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/endpoints?service_id=40d253afc9824e7b842a708c8982d494&interface=admin®ion_id=RegionOne => generated 193 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:27.744361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.756155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bc555-f18b-49ac-800f-3dbf213fdf60 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.757697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:27.759531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:27.760993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.761662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.761939 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.762212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.764173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.764562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.773991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 493/998] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:03:27.779167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 505/998] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:27.798075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.809079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d53b6-d71e-4f17-a61b-08fb1fe55f7a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.813821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.814618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.814900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.815243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.815907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.818085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.830823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 14 03:03:27.832726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 494/999] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:27.839808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.849748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdb88-8951-45f1-ac24-9167b1fa2990 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.854748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.855491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.855772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.856042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.856802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.857104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.858752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.865060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 506/1000] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:27.871432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.882875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd453eb-f4c2-429c-be5a-a21f21c378a9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.888407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.888407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.888638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.888919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.889962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.889962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.891553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.898030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 495/1001] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:27.904585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.914985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0cfc-df3f-4b63-97df-918eedeee409 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.919934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.920602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.920882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.921156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.921969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] RBAC: Adding query filter params (interface=public, service_id=f2e3eb4b9f1a4dd285ee3c140bb0c653, region_id=RegionOne) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:27.922280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.923938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc8d8c-d2fc-4c08-9e8d-9111d09573d5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.930170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 507/1002] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/endpoints?service_id=f2e3eb4b9f1a4dd285ee3c140bb0c653&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:27.936447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:27.947662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e80bd-4a1a-47b1-b92e-18f8d08c4c67 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:27.952432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec205-21d3-40fc-a1ef-389fb7a96f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:27.953091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec205-21d3-40fc-a1ef-389fb7a96f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:27.953415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec205-21d3-40fc-a1ef-389fb7a96f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:27.953692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec205-21d3-40fc-a1ef-389fb7a96f84 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:27.954387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ec205-21d3-40fc-a1ef-389fb7a96f84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:27.956122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ec205-21d3-40fc-a1ef-389fb7a96f84 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:27.964351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 496/1003] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:27 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:03:30.020888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eff4a7-1460-4634-9df5-70ba46906795 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.021392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eff4a7-1460-4634-9df5-70ba46906795 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.021392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eff4a7-1460-4634-9df5-70ba46906795 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.023340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 508/1004] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:30.029150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.029541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.029721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.046790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:30.047998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:30.055567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 497/1005] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:30.079464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eff4a7-1460-4634-9df5-70ba46906795 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.092238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eff4a7-1460-4634-9df5-70ba46906795 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.096441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.097195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.097471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.097768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.098448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.100054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.110484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 14 03:03:30.111795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 509/1006] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:30.118229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.127000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c3e6-5413-43fd-b0f2-649d8ce7493f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.131948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.132586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.132860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.133135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.133842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.134140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.135742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3af15d-7223-40db-a902-e249461d6b5c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.140897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 498/1007] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:30.147463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.152253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8ae1-e0ef-40d2-9766-30eb8abebff3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.152772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8ae1-e0ef-40d2-9766-30eb8abebff3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.153054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8ae1-e0ef-40d2-9766-30eb8abebff3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.154791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 499/1008] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:03:30.157373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d0112-663e-4bee-b1b6-e1f94de706a1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.160342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.160690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.160904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.162204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.162830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.163143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.163416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.164394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.164706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.166271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.171262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 510/1009] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:30.177338 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.179321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:30.180489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:30.187021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf149ef-f02e-46e4-b598-83b980e84e4c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.188244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 500/1010] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:30.192136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.192754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.193033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.193301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.194081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] RBAC: Adding query filter params (interface=public, service_id=22818e9945c94c0f9dcae6b356e4c917, region_id=RegionOne) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.194386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.195993 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.203089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 511/1011] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/endpoints?service_id=22818e9945c94c0f9dcae6b356e4c917&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:30.206915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.212453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.216905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d15cb-0c79-4e7b-aa64-307dd09b7406 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.221461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17d58-f861-45d9-bbe2-9ae645a3802a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.221945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.222675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.222979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.223265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.223955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.225535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.226267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.227034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.227345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.227616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.228264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.229814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.232588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 501/1012] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:03:30.244889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 14 03:03:30.246415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 512/1013] 10.222.0.43 () {56 vars in 1147 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:30.253002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.263936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b512a6c-c6bb-4b83-8a9c-fed0d379e7cd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.268706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.271641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.271641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.271641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.271641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.271641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.272630 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535ecd8-cbc9-41a7-9cdc-8e2a0cdfe3bc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.278662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 502/1014] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:30.284802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.298500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282e03-5c6e-4f1f-b839-21b5489a0e91 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.304474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.305176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.305452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.305717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.306589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.307067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.308887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.309590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832dad-eb14-4405-b285-17a38de1e10e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.309882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832dad-eb14-4405-b285-17a38de1e10e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.310360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832dad-eb14-4405-b285-17a38de1e10e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.312128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 503/1015] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:30.314938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 513/1016] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:30.319289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.319289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.319289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.322499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.332357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5c2de-d631-4a58-bd5f-006803913a9e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.337044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.337504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:30.337698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.337980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.338253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.338730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:30.339029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.340649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.346684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 504/1017] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:30.357360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 514/1018] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:30 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:03:30.372090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.382375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30b646-ea4c-4b47-a0de-515308b5de86 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.400649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.400649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.400958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.401233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.401936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.403666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.415708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 14 03:03:30.417184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 505/1019] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:30.423937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.435881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccc4e3-40c1-4720-a14b-cbeedca6529f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.440729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.441447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.442249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.442522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.443311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.443623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.445436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.453866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 515/1020] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:30.457699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.468079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df936f31-ee23-4e8e-ae12-8b79d4e817c3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.473328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.474043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.474326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.474606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.475392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:30.475698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.477467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd35087-4be4-4b23-969e-4fe31fbca1ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.483724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 506/1021] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Dec 14 03:03:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:30.491121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:30.501361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dd2e-0a6d-4f51-969f-976fc709f233 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:30.507323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9a97-0a4d-4865-8f44-30dc23b99491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:30.508302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9a97-0a4d-4865-8f44-30dc23b99491 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:30.508772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9a97-0a4d-4865-8f44-30dc23b99491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:30.509221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9a97-0a4d-4865-8f44-30dc23b99491 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:30.510158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9a97-0a4d-4865-8f44-30dc23b99491 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:30.512015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9a97-0a4d-4865-8f44-30dc23b99491 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:30.534066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 516/1022] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:30 2021] POST /identity/v3/endpoints => generated 334 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:32.626858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028ec63-d572-40de-926f-2bade08240b2 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.627402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028ec63-d572-40de-926f-2bade08240b2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.627511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028ec63-d572-40de-926f-2bade08240b2 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.631137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 507/1023] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:32.636102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae804b2-ec98-4fc7-ae7b-21ef1f4443cc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.636545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae804b2-ec98-4fc7-ae7b-21ef1f4443cc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.636618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae804b2-ec98-4fc7-ae7b-21ef1f4443cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.662297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dae804b2-ec98-4fc7-ae7b-21ef1f4443cc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:32.663751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dae804b2-ec98-4fc7-ae7b-21ef1f4443cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:32.695333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 517/1024] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:32 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:32.720345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028ec63-d572-40de-926f-2bade08240b2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:32.736873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028ec63-d572-40de-926f-2bade08240b2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:32.742070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:32.743086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.743607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.744227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] PATH_INFO: `/v3/services/image` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.745160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:32.746928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:32.759783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 14 03:03:32.760663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0daa45-a4bb-43b8-af25-a45694dae3f1 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.760957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0daa45-a4bb-43b8-af25-a45694dae3f1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.761237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0daa45-a4bb-43b8-af25-a45694dae3f1 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.761336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 508/1025] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Dec 14 03:03:32 2021] GET /identity/v3/services/image => generated 86 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:32.763284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 518/1026] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:32.768908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.769199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.770054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.771410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:32.781906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61fb6-ca1c-4f62-b260-7ae139036fbb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:32.787661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:32.788409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.788796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.789181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.790009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] RBAC: Adding query filter params (name=image) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:32.790416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:32.790937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:32.792221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:32.792460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:32.802613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 509/1027] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:32 2021] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:32.803634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:32.810188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 519/1028] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:32 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:32.818276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab798-077f-467e-a8ad-da9ee95401fd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:32.822874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:32.823540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.823820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.824094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.824799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:32.825104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:32.826668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:32.830821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:32.839606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 510/1029] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:32 2021] GET /identity/v3/services?type=image => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:32.845427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7685602-dea9-46c1-8d3d-3a6734eb76c9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:32.845680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:32.850581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:32.851418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.851701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.852544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.855188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:32.855681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba99c61-7e03-4f58-a0da-3aa63ce44032 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:32.856881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:32.858628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 520/1030] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:32.865283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:32.866220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57c92-993f-4435-80c0-e59f9ccd99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:32.866876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57c92-993f-4435-80c0-e59f9ccd99f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.867198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57c92-993f-4435-80c0-e59f9ccd99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.867475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57c92-993f-4435-80c0-e59f9ccd99f0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.868233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a57c92-993f-4435-80c0-e59f9ccd99f0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:32.869817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a57c92-993f-4435-80c0-e59f9ccd99f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:32.876086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dead13-5393-4d3d-a9af-5fbe9aa2fc19 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:32.882481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80988a-37af-4f3b-b72c-72436f59c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:32.883230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80988a-37af-4f3b-b72c-72436f59c025 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:32.883568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80988a-37af-4f3b-b72c-72436f59c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:32.883848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80988a-37af-4f3b-b72c-72436f59c025 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:32.884667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80988a-37af-4f3b-b72c-72436f59c025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:32.887073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80988a-37af-4f3b-b72c-72436f59c025 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:32.893697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 511/1031] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:03:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:03:32.921576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 521/1032] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:32 2021] POST /identity/v3/projects => generated 311 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:03:33.005903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d69a-ab53-4e1c-912e-d429bc4b1e25 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.005903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d69a-ab53-4e1c-912e-d429bc4b1e25 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.005903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d69a-ab53-4e1c-912e-d429bc4b1e25 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.008195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 512/1033] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:33.014614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.014942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.015212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.034855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:33.036150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:33.110602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 522/1034] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:33.136958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02d69a-ab53-4e1c-912e-d429bc4b1e25 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.151435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02d69a-ab53-4e1c-912e-d429bc4b1e25 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.155913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.156703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.156972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.157240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.169518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:33.176665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 14 03:03:33.179117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 513/1035] 10.222.0.43 () {56 vars in 1141 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:33.184692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.194970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8cee5-6db1-43e7-a8b8-e53bbf70571f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.199855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.200509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.200785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.201054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.201814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:33.202115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.203759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.215961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 523/1036] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:33.221999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.232417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f026d-7945-4156-8e8c-906cb9806939 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.236921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.237956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.238767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.239035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.249382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.251222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.268096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:33.269264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 514/1037] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:33.275526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.285089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca3f0-c3c2-4f1c-aced-e05dab6beb61 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.289548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.290182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.290457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.290730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.291489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:33.291787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.293366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.306751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 524/1038] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:33.313618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.325380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdedb8-2bb6-43db-b0bb-815f546f1798 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.330263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.331170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.331453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.331808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.339672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.341789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.355997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:03:33.358204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 515/1039] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:03:33.364446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.374000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65d29e-1df4-40d4-bf03-e021f5cedcfe admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.378468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.379801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.380146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.380483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.381493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:33.381888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.383857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.400882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 525/1040] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:33.406973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.416584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66011297-8ac6-4163-8117-5170aa44d5b9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.421071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.421683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.421958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.422225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.430333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.432063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.440661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 516/1041] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:33.447168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.456493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dbd3f-5541-4bc1-8364-ea40c5fbb958 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.461593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.462349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.462629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.462897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.473340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.475212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.491428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:33.492679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 526/1042] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:33.498727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.507544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df9454-cac7-4f95-83a4-8cb67974c341 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.513949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.515019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.515554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.516006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.517161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:33.517686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.520723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.538372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 517/1043] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:33.551695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.561756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf31b4-e457-4bae-8035-ee25e28fe0d1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.566493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.567382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.567735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.568081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.574948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.576919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.589951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:33.591281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 527/1044] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:33.597644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.608032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7034-7473-474e-94d0-ef4fe27dfb88 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.612868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.613603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.613978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.614345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.615252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:33.615671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.617572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf59a7-e7cf-4925-8f0a-605c9c735135 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.631012 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 518/1045] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:33.637113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:33.648268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0427-0e18-4f3d-af75-5958e6973753 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:33.652989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:33.653672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:33.654058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:33.654464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:33.657358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] RBAC: Adding query filter params (role.id=d346ddef828944bfad57bec70ad88927, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=b1d2810610e748859ea9ff10d45190b1) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:33.657358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:33.657752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e864-885e-4d74-accd-6df00d75b5e9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:33.663900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 528/1046] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:33 2021] GET /identity/v3/role_assignments?user.id=b1d2810610e748859ea9ff10d45190b1&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=d346ddef828944bfad57bec70ad88927 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:35.328379 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccfce0-af72-4e16-b7c1-d19da99441ea None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.328924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccfce0-af72-4e16-b7c1-d19da99441ea None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.329016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccfce0-af72-4e16-b7c1-d19da99441ea None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.330750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 519/1047] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:35.336599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.336998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.337172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.344726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba943f9c-f30b-4f42-b482-0d999af472b4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.345091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba943f9c-f30b-4f42-b482-0d999af472b4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.345363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba943f9c-f30b-4f42-b482-0d999af472b4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.347102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 520/1048] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:35.353781 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.354058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.354329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.355534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:35.357160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:35.365378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 529/1049] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:35.373354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:35.374539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:35.383187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 521/1050] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:35.387885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:35.396836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8a88-180a-43bf-bcf5-fb4924969a27 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:35.401391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:35.402012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.402300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.402575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.410663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:35.410774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:35.412529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:35.420237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355961a0-8912-4a5e-bd2c-423de3eff9c9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:35.427108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 530/1051] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:35.427234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:35.427234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.427234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.427234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.428070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:35.428171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:35.429727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:35.431428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 522/1052] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:35.437096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a65a1-c547-41db-99ca-75db1c4b6bd7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:35.437520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:35.441666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd7116-aa2c-4e08-88a0-b1fa72b072b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:35.442435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd7116-aa2c-4e08-88a0-b1fa72b072b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.442715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd7116-aa2c-4e08-88a0-b1fa72b072b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.442987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd7116-aa2c-4e08-88a0-b1fa72b072b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.444195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd7116-aa2c-4e08-88a0-b1fa72b072b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:35.445870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd7116-aa2c-4e08-88a0-b1fa72b072b0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:35.446780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3be4a4-76a5-4731-98b3-b7d0af6f9dd3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:35.447493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 531/1053] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:35.452194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c1257-6f75-4ea0-9661-163191952e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:35.452855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c1257-6f75-4ea0-9661-163191952e12 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:35.453135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c1257-6f75-4ea0-9661-163191952e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:35.453406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c1257-6f75-4ea0-9661-163191952e12 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:35.454127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c1257-6f75-4ea0-9661-163191952e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:35.456095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c1257-6f75-4ea0-9661-163191952e12 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:35.479207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 523/1054] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:03:35 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:03:36.074239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272182b-a3bb-4107-9ddd-99f4d673b018 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.074522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272182b-a3bb-4107-9ddd-99f4d673b018 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.074794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272182b-a3bb-4107-9ddd-99f4d673b018 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.076599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 532/1055] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:36.082950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.083274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.083554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.100858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:36.102043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:36.109604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 524/1056] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:36.133211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272182b-a3bb-4107-9ddd-99f4d673b018 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.145164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272182b-a3bb-4107-9ddd-99f4d673b018 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.149493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.150263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.150542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.150813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.161346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:36.168456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 14 03:03:36.169582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 533/1057] 10.222.0.43 () {56 vars in 1141 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:36.175624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.184764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f894-fc01-4dbb-b315-1a89ff441862 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.189305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.189938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.190213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.190481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.191311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:36.191612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.193178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.205583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 525/1058] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:36.206637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.216391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed1673-b572-4d78-8e09-a4355f3776c4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.220866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.221599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.221880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.222152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.232558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.234387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.252097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:36.253250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 534/1059] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:36.259292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.268714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2ecbc-bcd5-40c4-b85f-31af5773a20e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.273684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.274317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.274596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.274872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.275623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:36.275927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.277485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.294235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 526/1060] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:36.295432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.306458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34f35-c83c-45be-b81b-b2b729b23211 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.311388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.312161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.312437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.312706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.319929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.321920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.335581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:03:36.336651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 535/1061] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:36.342761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.352858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897419c-91c7-4873-adbe-74317858f952 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.357344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.357985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.358264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.358535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.359401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:36.359706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.361520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.378399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 527/1062] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:36.384486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.394012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b2177-77d0-494e-a6dc-190e5c2c370e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.399018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.399816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.400094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.400365 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.410862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.412689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.428812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:36.429956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 536/1063] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:36.435990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.445582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f76cda-55bf-4591-b788-2d52fcf82d48 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.450005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.450642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.450919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.451294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.452014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:36.452316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.453887 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.474711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 528/1064] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:36.476016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.485466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fb5fd-de66-4825-8142-5e6fb11bbc14 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.490144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.490900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.491209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.491478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.498186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.500157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.512580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:36.513707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 537/1065] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:36.520263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.529621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340f1d-c90f-40de-abfb-7403fa47db7b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.534064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.534692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.535592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.535874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.536651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:36.536955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.538764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c032-407f-42e5-9697-53c088633737 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.555347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 529/1066] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:36.556464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:36.566519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5491ab-900b-4450-ba7c-c8a734ddb5a9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:36.570899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ace1a-aecf-4f67-8052-d4fd4912f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:36.571780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ace1a-aecf-4f67-8052-d4fd4912f270 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:36.572059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ace1a-aecf-4f67-8052-d4fd4912f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:36.572330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ace1a-aecf-4f67-8052-d4fd4912f270 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/b1d2810610e748859ea9ff10d45190b1/roles/d346ddef828944bfad57bec70ad88927` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:36.574513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ace1a-aecf-4f67-8052-d4fd4912f270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=b1d2810610e748859ea9ff10d45190b1, role_id=d346ddef828944bfad57bec70ad88927)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:36.577123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ace1a-aecf-4f67-8052-d4fd4912f270 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:36.590230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 538/1067] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:36 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/b1d2810610e748859ea9ff10d45190b1/roles/d346ddef828944bfad57bec70ad88927 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:03:37.900920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984ebf-3147-4a44-b52d-2b041c76b9f9 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:37.901498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984ebf-3147-4a44-b52d-2b041c76b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:37.901498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984ebf-3147-4a44-b52d-2b041c76b9f9 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:37.903293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 530/1068] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:37.909196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:37.909615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:37.909717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:37.927959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:37.929141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:37.983681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 539/1069] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:38.008896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984ebf-3147-4a44-b52d-2b041c76b9f9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.021329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984ebf-3147-4a44-b52d-2b041c76b9f9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.025682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.026506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.026850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.027243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.037732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:38.044388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:38.045670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 531/1070] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:38.051765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.060531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aec0cd-7c46-40b5-8838-125c22e56bc6 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.065078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.065716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.065997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.066297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.067058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:38.067391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:38.068966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:38.076888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 540/1071] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:38.083277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.092917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7a1b-61d0-46fd-b3c3-efacb188c5a3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.097343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.098723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.098999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.099291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] PATH_INFO: `/v3/users/d36412ab05a44181b3e8f94c5570fa7d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.111779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=d36412ab05a44181b3e8f94c5570fa7d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:38.114120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:38.115716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 532/1072] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/users/d36412ab05a44181b3e8f94c5570fa7d => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:38.121666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.131345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c4713-c754-4b38-a081-de9f1160117f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.135696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.136300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.136576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.136846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.144257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:38.146479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:38.155009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 541/1073] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:03:38.160698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.169609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2984-b05f-4829-b3ca-9e5db7c719a2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.173964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8a6d-ef0c-4892-ac1b-809668fccd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.174767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8a6d-ef0c-4892-ac1b-809668fccd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.175062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8a6d-ef0c-4892-ac1b-809668fccd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.175330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8a6d-ef0c-4892-ac1b-809668fccd6e admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.176500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8a6d-ef0c-4892-ac1b-809668fccd6e admin admin] RBAC: Authorizing `identity:get_project(project_id=4a56a148f202490c98ca4014e0cca18e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:38.178459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8a6d-ef0c-4892-ac1b-809668fccd6e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:38.180077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 533/1074] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:38.186175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.195260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4afa2-e9a7-4bff-8699-d91f39634834 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.199715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.200323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.200602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.200875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.201698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=4a56a148f202490c98ca4014e0cca18e, user.id=d36412ab05a44181b3e8f94c5570fa7d) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:38.202003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:38.203847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9da8-64a2-484b-836c-abbfe9fe69a3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:38.219070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 542/1075] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/role_assignments?user.id=d36412ab05a44181b3e8f94c5570fa7d&scope.project.id=4a56a148f202490c98ca4014e0cca18e&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:38.914216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9c67a-efb5-42d7-8b26-475f4bc73507 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.914708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9c67a-efb5-42d7-8b26-475f4bc73507 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.914708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9c67a-efb5-42d7-8b26-475f4bc73507 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.916483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 534/1076] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:38.922203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.922623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.922821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:38.940499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:38.941658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:38.949077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 543/1077] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:38.973054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9c67a-efb5-42d7-8b26-475f4bc73507 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:38.985087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9c67a-efb5-42d7-8b26-475f4bc73507 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:38.990248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:38.991029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:38.991335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:38.991608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.001535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:39.008741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 14 03:03:39.009920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 535/1078] 10.222.0.43 () {56 vars in 1141 bytes} [Tue Dec 14 03:03:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:39.016428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.025226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c7c35-51ec-447c-a6d8-8a671fea5723 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.029642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.030278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.030554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.030822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.031608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:39.031907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.033474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.041784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 544/1079] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:39.047748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.058216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bd042-10f6-4834-9a6a-a9e7202c7b28 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.062672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.063453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.063727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.063991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.073789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.075622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.091525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:39.092809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 536/1080] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:39.099272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.108711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac1298-637a-47a4-a4c1-3bb41c6f6bb4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.113987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.114682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.115027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.115326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.116044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:39.116341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.117911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.130189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 545/1081] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:39.136011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.145287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee07b-9c76-499e-9cd5-bf0d11f3cafe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.149673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.150422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.150699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.150965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.157970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.160493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.175294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 14 03:03:39.177003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 537/1082] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:39.183068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.192521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1abc-1bc3-41c6-adfe-855102972362 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.196889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.197524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.197801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.198075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.198903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:39.199231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.201035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.217644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 546/1083] 10.222.0.43 () {56 vars in 1154 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:39.224357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.233983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21404-3ad1-45a2-9235-d963d8677bdd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.239483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.240116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.240398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.240673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.248695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.250432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.259112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 538/1084] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:03:39.265413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.275366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ff6b-6f5c-4726-ad84-5307917d0e24 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.279790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.280547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.280823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.281089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.291583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.293411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.310037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:03:39.311326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 547/1085] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:39.317679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.326735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e9c3-eeca-421b-8c7c-95eb97066f59 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.331364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.332578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.332917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.333254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.334047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:39.334419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.336096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.352436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 539/1086] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:39.353625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.363366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c690a9-a580-437f-b005-baf68131fd38 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.367752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.368505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.368780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.369045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.375669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.377598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.389797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:03:39.390901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 548/1087] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:39.397351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.406938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0f7e-4aff-4206-9d65-e33a32710754 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.412167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.412865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.413215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.413498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.414287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:39.414594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.416450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3d3bb-a713-4a87-8376-72b7ff5cb2a9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.428529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 540/1088] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:39.434877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:39.445040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd5e0-6d6c-4adf-9600-ac657da37da0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:39.449521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:39.450144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:39.450424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:39.450700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:39.451564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] RBAC: Adding query filter params (role.id=d346ddef828944bfad57bec70ad88927, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=b1d2810610e748859ea9ff10d45190b1) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:39.451876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:39.453696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0492af-29ae-4a7a-8ddb-463cec0b0652 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:39.460112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 549/1089] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:39 2021] GET /identity/v3/role_assignments?user.id=b1d2810610e748859ea9ff10d45190b1&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=d346ddef828944bfad57bec70ad88927 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:40.522557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5d9e-3de5-4272-8dad-949bfb2d4ded None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.523133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5d9e-3de5-4272-8dad-949bfb2d4ded None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.523220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5d9e-3de5-4272-8dad-949bfb2d4ded None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.525013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 541/1090] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:40.530833 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.531268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.531421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.549011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:40.550182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:40.558252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 550/1091] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:40.580689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5d9e-3de5-4272-8dad-949bfb2d4ded None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:40.592496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5d9e-3de5-4272-8dad-949bfb2d4ded None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:40.596760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:40.598049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.598357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.598656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.608569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:40.616173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:40.617302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 542/1092] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:40.623278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:40.631937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f32ed-4a26-46c8-8147-211cab9ac13c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:40.637043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:40.637673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.637954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.638224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.638971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:40.639304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:40.640882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:40.648935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 551/1093] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:40.654884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:40.665609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daf807-b839-49e6-a278-8b726469f481 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:40.670139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:40.670985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.671327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.671658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] PATH_INFO: `/v3/users/d36412ab05a44181b3e8f94c5570fa7d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.672911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] RBAC: Authorizing `identity:get_user(user_id=d36412ab05a44181b3e8f94c5570fa7d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:40.675032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:40.677300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 543/1094] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:40 2021] GET /identity/v3/users/d36412ab05a44181b3e8f94c5570fa7d => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:40.683171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:40.692609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee6e98-c172-4d2b-8ac1-b9a5dc424bd8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:40.697138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231aeea-5d34-4096-b354-23dd4d846d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:40.697954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231aeea-5d34-4096-b354-23dd4d846d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.698235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231aeea-5d34-4096-b354-23dd4d846d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.698505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231aeea-5d34-4096-b354-23dd4d846d24 admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.699695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231aeea-5d34-4096-b354-23dd4d846d24 admin admin] RBAC: Authorizing `identity:get_project(project_id=4a56a148f202490c98ca4014e0cca18e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:40.701716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231aeea-5d34-4096-b354-23dd4d846d24 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:40.703371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 552/1095] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:03:40 2021] GET /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:40.708987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:40.718374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729d56f-b38e-44f6-8298-de07e253b66a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:40.723348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c8703-eefe-43bc-9dac-3daae505bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:40.724194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c8703-eefe-43bc-9dac-3daae505bdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:40.724506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c8703-eefe-43bc-9dac-3daae505bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:40.724823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c8703-eefe-43bc-9dac-3daae505bdd4 admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e/users/d36412ab05a44181b3e8f94c5570fa7d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:40.726848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c8703-eefe-43bc-9dac-3daae505bdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a56a148f202490c98ca4014e0cca18e, user_id=d36412ab05a44181b3e8f94c5570fa7d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:40.729431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c8703-eefe-43bc-9dac-3daae505bdd4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:40.742762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 544/1096] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:40 2021] PUT /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e/users/d36412ab05a44181b3e8f94c5570fa7d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:03:43.033980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567eb79-06a7-4358-a2c4-c79dc7b1c41e None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.034479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567eb79-06a7-4358-a2c4-c79dc7b1c41e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.034479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567eb79-06a7-4358-a2c4-c79dc7b1c41e None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.036262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 553/1097] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:43.041965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.042374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.042593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.060312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:43.061482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:43.116650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 545/1098] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:43.140602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567eb79-06a7-4358-a2c4-c79dc7b1c41e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:43.152943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567eb79-06a7-4358-a2c4-c79dc7b1c41e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:43.157176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:43.157922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.158198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.158469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.168806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:03:43.175479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:03:43.176584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 554/1099] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:03:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:03:43.182667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:43.191285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf0292-7b19-4752-970e-df46a90b34ca None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:43.195732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:43.196367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.196649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.196923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.197667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:43.197976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:43.199586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:43.209051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 546/1100] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:03:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:43.215473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:43.226583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7aeab-6865-48e8-8ea9-d7fc54a73bc8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:43.231160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:43.231971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.232247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.232516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] PATH_INFO: `/v3/users/d36412ab05a44181b3e8f94c5570fa7d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.233688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] RBAC: Authorizing `identity:get_user(user_id=d36412ab05a44181b3e8f94c5570fa7d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:43.235818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:43.237360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 555/1101] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:43 2021] GET /identity/v3/users/d36412ab05a44181b3e8f94c5570fa7d => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:43.243445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:43.252640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f961-7461-4b12-ba17-1eaeb36356b3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:43.257048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:43.257657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.257931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.258199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.265502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:43.267212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:43.276105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 547/1102] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:43.281802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:43.291377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeccd8-f13d-4d17-9da0-95e43b459684 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:43.295656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487af4-0283-4244-8750-5d925b5a4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:43.296426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487af4-0283-4244-8750-5d925b5a4b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.296700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487af4-0283-4244-8750-5d925b5a4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.296965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487af4-0283-4244-8750-5d925b5a4b05 admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.298099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487af4-0283-4244-8750-5d925b5a4b05 admin admin] RBAC: Authorizing `identity:get_project(project_id=4a56a148f202490c98ca4014e0cca18e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:43.300088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487af4-0283-4244-8750-5d925b5a4b05 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:43.301726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 556/1103] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:03:43 2021] GET /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:43.308153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:43.316828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7e876-0adb-4427-a36d-a5cca56f6191 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:43.321251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:43.321850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:43.322126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:43.322396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:43.323240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=4a56a148f202490c98ca4014e0cca18e, user.id=d36412ab05a44181b3e8f94c5570fa7d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:43.323548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:43.325319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed64d7-0b6b-4519-b809-3c501bfce40a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:43.330760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 548/1104] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:43 2021] GET /identity/v3/role_assignments?user.id=d36412ab05a44181b3e8f94c5570fa7d&scope.project.id=4a56a148f202490c98ca4014e0cca18e&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:45.652157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6682a-a50b-4003-8458-583b290a46bd None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:45.652715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6682a-a50b-4003-8458-583b290a46bd None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:45.652715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6682a-a50b-4003-8458-583b290a46bd None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:45.654486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 557/1105] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:45.660608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:45.661005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:45.661243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:45.678718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:45.679940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:45.687620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 549/1106] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:45.720783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6682a-a50b-4003-8458-583b290a46bd None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:45.732803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6682a-a50b-4003-8458-583b290a46bd None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:45.737146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9e33-d3c5-4fb7-85fc-0291d8e563f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:45.738161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9e33-d3c5-4fb7-85fc-0291d8e563f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:45.738440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9e33-d3c5-4fb7-85fc-0291d8e563f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:45.738711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9e33-d3c5-4fb7-85fc-0291d8e563f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:45.739920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9e33-d3c5-4fb7-85fc-0291d8e563f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:45.741597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9e33-d3c5-4fb7-85fc-0291d8e563f6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:45.743175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 558/1107] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:45.748802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:45.758029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f370f1-a8e3-428d-ae75-c02474d93889 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:45.762502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ba64e-28f0-4278-87d4-e25cb5ed5408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:45.763186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ba64e-28f0-4278-87d4-e25cb5ed5408 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:45.763469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ba64e-28f0-4278-87d4-e25cb5ed5408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:45.763741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ba64e-28f0-4278-87d4-e25cb5ed5408 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:45.764458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ba64e-28f0-4278-87d4-e25cb5ed5408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:45.766360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ba64e-28f0-4278-87d4-e25cb5ed5408 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:45.786731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 550/1108] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:03:45 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:03:48.134184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540734-46cf-43c8-9126-fe64a9f5e545 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.134763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540734-46cf-43c8-9126-fe64a9f5e545 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.134763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540734-46cf-43c8-9126-fe64a9f5e545 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.136528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 559/1109] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:48.142337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.142749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.142884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.160530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:48.161686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:48.169165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 551/1110] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:48.192954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540734-46cf-43c8-9126-fe64a9f5e545 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:48.204738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540734-46cf-43c8-9126-fe64a9f5e545 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:48.209068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:48.209874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.210150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.210420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] PATH_INFO: `/v3/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.211898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] RBAC: Authorizing `identity:get_role(role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:48.212910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:48.212910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:03:48.212910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:03:48.213762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:48.215066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 560/1111] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:48 2021] GET /identity/v3/roles/a6a04d23aca344bc927a9b392991e951 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:48.220692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:48.229612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46948a8b-a24e-468d-ac53-dd93cdeaf265 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:48.233969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:48.234786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.235087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.235360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] PATH_INFO: `/v3/users/5ea2c0ee52c749cca7b7619e46a37649` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.248885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] RBAC: Authorizing `identity:get_user(user_id=5ea2c0ee52c749cca7b7619e46a37649)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:48.250964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:48.252533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 552/1112] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:48 2021] GET /identity/v3/users/5ea2c0ee52c749cca7b7619e46a37649 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:48.258186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:48.267371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3546-a1d9-4abc-b6ad-92b6db77c8df admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:48.272292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:48.272884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.273163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.273434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.280853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:48.282520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:48.291592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 561/1113] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:48.297255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:48.309968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109bce-6656-40cd-a9fd-1528cf0ddb2f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:48.315133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9ccb1-eba7-4d01-85a6-32a330559ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:48.315967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ccb1-eba7-4d01-85a6-32a330559ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.316243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ccb1-eba7-4d01-85a6-32a330559ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.316510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ccb1-eba7-4d01-85a6-32a330559ac3 admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.317741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9ccb1-eba7-4d01-85a6-32a330559ac3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4a56a148f202490c98ca4014e0cca18e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:48.319766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9ccb1-eba7-4d01-85a6-32a330559ac3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:48.321393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 553/1114] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:03:48 2021] GET /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:48.327835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:48.337017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c12503-b1c0-4596-9cb4-6b050a2e0e3e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:48.341500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:48.342113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:48.342392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:48.342665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:48.343529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] RBAC: Adding query filter params (role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=4a56a148f202490c98ca4014e0cca18e, user.id=5ea2c0ee52c749cca7b7619e46a37649) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:48.343860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:48.345668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048124f8-ba00-45c4-820c-9a6b6576fb0f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:48.351523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 562/1115] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:48 2021] GET /identity/v3/role_assignments?user.id=5ea2c0ee52c749cca7b7619e46a37649&scope.project.id=4a56a148f202490c98ca4014e0cca18e&role.id=a6a04d23aca344bc927a9b392991e951 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:50.785387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c0d6-b1b5-4b37-8c1f-3a78c6bb970c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:50.785903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c0d6-b1b5-4b37-8c1f-3a78c6bb970c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:50.786011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c0d6-b1b5-4b37-8c1f-3a78c6bb970c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:50.787719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 554/1116] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:50.794983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:50.795446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:50.795544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:50.812661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:50.813821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:50.821309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 563/1117] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:50.844592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312c0d6-b1b5-4b37-8c1f-3a78c6bb970c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:50.857092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312c0d6-b1b5-4b37-8c1f-3a78c6bb970c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:50.861432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:50.862247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:50.862783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:50.863090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] PATH_INFO: `/v3/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:50.864562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] RBAC: Authorizing `identity:get_role(role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:50.865569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:03:50.865569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:03:50.865569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:03:50.866429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:50.867747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 555/1118] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:50 2021] GET /identity/v3/roles/a6a04d23aca344bc927a9b392991e951 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:50.873542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:50.882636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19edc65-c55e-435c-a912-c3a637cb2c05 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:50.886994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:50.887887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:50.888163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:50.888434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] PATH_INFO: `/v3/users/5ea2c0ee52c749cca7b7619e46a37649` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:50.889618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ea2c0ee52c749cca7b7619e46a37649)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:50.891739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:50.893259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 564/1119] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:50 2021] GET /identity/v3/users/5ea2c0ee52c749cca7b7619e46a37649 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:50.899548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:50.908665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef657c-36e2-4ada-bf43-5b882e0518c0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:50.913058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c030033-6ff1-474c-9f7b-acdc73eb3f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:50.913832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c030033-6ff1-474c-9f7b-acdc73eb3f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:50.914115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c030033-6ff1-474c-9f7b-acdc73eb3f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:50.914405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c030033-6ff1-474c-9f7b-acdc73eb3f51 admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:50.915587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c030033-6ff1-474c-9f7b-acdc73eb3f51 admin admin] RBAC: Authorizing `identity:get_project(project_id=4a56a148f202490c98ca4014e0cca18e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:50.917535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c030033-6ff1-474c-9f7b-acdc73eb3f51 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:50.919125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 556/1120] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:03:50 2021] GET /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:50.924697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:50.933601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6cf8-5866-482f-9b27-34f6011ad477 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:50.937967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378817c-eb1d-4e82-bcb4-201720319b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:50.938762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378817c-eb1d-4e82-bcb4-201720319b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:50.939056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378817c-eb1d-4e82-bcb4-201720319b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:50.939336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378817c-eb1d-4e82-bcb4-201720319b9f admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e/users/5ea2c0ee52c749cca7b7619e46a37649/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:50.942022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378817c-eb1d-4e82-bcb4-201720319b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a56a148f202490c98ca4014e0cca18e, user_id=5ea2c0ee52c749cca7b7619e46a37649, role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:50.944579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378817c-eb1d-4e82-bcb4-201720319b9f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:50.957215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 565/1121] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:03:50 2021] PUT /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e/users/5ea2c0ee52c749cca7b7619e46a37649/roles/a6a04d23aca344bc927a9b392991e951 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:03:53.244265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ccb0e-1a27-4930-a6d7-65ab3c1154b0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.244816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ccb0e-1a27-4930-a6d7-65ab3c1154b0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.244816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ccb0e-1a27-4930-a6d7-65ab3c1154b0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.246571 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 557/1122] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:53.252160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.252591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.252709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.270361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:53.271573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:53.330161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 566/1123] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:53.354788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ccb0e-1a27-4930-a6d7-65ab3c1154b0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:53.366973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ccb0e-1a27-4930-a6d7-65ab3c1154b0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:53.371264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:53.372073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.372350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.372618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] PATH_INFO: `/v3/roles/a6a04d23aca344bc927a9b392991e951` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.374052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] RBAC: Authorizing `identity:get_role(role_id=a6a04d23aca344bc927a9b392991e951)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:53.375636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:53.376921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 558/1124] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:53 2021] GET /identity/v3/roles/a6a04d23aca344bc927a9b392991e951 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:53.382620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:53.391195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b190f-e73c-43c5-a2eb-57ca09e4c76d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:53.395586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:53.396411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.396695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.396970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] PATH_INFO: `/v3/users/5ea2c0ee52c749cca7b7619e46a37649` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.398154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] RBAC: Authorizing `identity:get_user(user_id=5ea2c0ee52c749cca7b7619e46a37649)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:53.400283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:53.401817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 567/1125] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:03:53 2021] GET /identity/v3/users/5ea2c0ee52c749cca7b7619e46a37649 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:53.407449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:53.416921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529791-e59c-4be3-9821-245e553a660d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:53.421298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:53.421878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.422155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.422425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.430454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:53.432139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:53.440616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 559/1126] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:03:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:03:53.446137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:53.455265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39722f1-fe4e-4e76-a7fc-dc72e2823eda admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:53.459726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78a004-6f92-47b9-978a-627fcb0018f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:53.460503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78a004-6f92-47b9-978a-627fcb0018f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.460784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78a004-6f92-47b9-978a-627fcb0018f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.461058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78a004-6f92-47b9-978a-627fcb0018f8 admin admin] PATH_INFO: `/v3/projects/4a56a148f202490c98ca4014e0cca18e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.462224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78a004-6f92-47b9-978a-627fcb0018f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4a56a148f202490c98ca4014e0cca18e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:53.464234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78a004-6f92-47b9-978a-627fcb0018f8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:53.465954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 568/1127] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:03:53 2021] GET /identity/v3/projects/4a56a148f202490c98ca4014e0cca18e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:53.472351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:53.480450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c77a78-edc6-4585-b332-ac1735020361 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:53.484848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:53.485428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:53.485703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:53.485971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:53.486764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] RBAC: Adding query filter params (role.id=a6a04d23aca344bc927a9b392991e951, scope.project.id=4a56a148f202490c98ca4014e0cca18e, user.id=5ea2c0ee52c749cca7b7619e46a37649) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:03:53.487090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:53.489485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415ebf-2682-4d7c-9049-e833e161c634 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:53.494978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 560/1128] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:03:53 2021] GET /identity/v3/role_assignments?user.id=5ea2c0ee52c749cca7b7619e46a37649&scope.project.id=4a56a148f202490c98ca4014e0cca18e&role.id=a6a04d23aca344bc927a9b392991e951 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:03:55.802923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5a0ed-4d10-463f-91bd-0a21617a98a8 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:55.803502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5a0ed-4d10-463f-91bd-0a21617a98a8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:55.803502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5a0ed-4d10-463f-91bd-0a21617a98a8 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:55.805341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 569/1129] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:55.811156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:55.811581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:55.811686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:55.829232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:55.830389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:55.837806 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 561/1130] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:03:55.861100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5a0ed-4d10-463f-91bd-0a21617a98a8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:55.873747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5a0ed-4d10-463f-91bd-0a21617a98a8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:55.878687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08134405-0ff4-4a3c-abfc-466fd151981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:55.879473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134405-0ff4-4a3c-abfc-466fd151981d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:55.879755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134405-0ff4-4a3c-abfc-466fd151981d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:55.880026 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134405-0ff4-4a3c-abfc-466fd151981d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:55.881198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08134405-0ff4-4a3c-abfc-466fd151981d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:55.882863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08134405-0ff4-4a3c-abfc-466fd151981d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:55.884448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 570/1131] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:55.890121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:55.898672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81746639-cb51-497e-99a4-629d2450fde9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:55.903123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46f35-e736-4c75-9673-05f50997e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:55.903738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46f35-e736-4c75-9673-05f50997e309 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:55.904012 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46f35-e736-4c75-9673-05f50997e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:55.904280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46f35-e736-4c75-9673-05f50997e309 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:55.904988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d46f35-e736-4c75-9673-05f50997e309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:55.906825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d46f35-e736-4c75-9673-05f50997e309 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:55.930905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 562/1132] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:03:55 2021] POST /identity/v3/projects => generated 311 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:03:58.260293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e609e8-e73d-4b97-a9c6-b28f0d8e50be None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:58.260818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e609e8-e73d-4b97-a9c6-b28f0d8e50be None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:58.260818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e609e8-e73d-4b97-a9c6-b28f0d8e50be None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:58.262577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 571/1133] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:03:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:03:58.268212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:58.268647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:58.268790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:58.285809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:03:58.286957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:03:58.341508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 563/1134] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:03:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:03:58.366764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e609e8-e73d-4b97-a9c6-b28f0d8e50be None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:58.379096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e609e8-e73d-4b97-a9c6-b28f0d8e50be None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:58.383329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646250f-e32a-4bba-b307-6ce5d07d1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:58.384076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646250f-e32a-4bba-b307-6ce5d07d1cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:58.384351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646250f-e32a-4bba-b307-6ce5d07d1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:58.384618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646250f-e32a-4bba-b307-6ce5d07d1cbe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:58.385771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646250f-e32a-4bba-b307-6ce5d07d1cbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:58.387462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646250f-e32a-4bba-b307-6ce5d07d1cbe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:58.388979 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 572/1135] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:03:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:03:58.394720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:03:58.403336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e3a39-a53f-4777-ac45-a700ae9412c6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:03:58.407802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8cd4b-9b03-4529-a945-e398b97331e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:03:58.408437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cd4b-9b03-4529-a945-e398b97331e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:03:58.408718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cd4b-9b03-4529-a945-e398b97331e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:03:58.408991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cd4b-9b03-4529-a945-e398b97331e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:03:58.410197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8cd4b-9b03-4529-a945-e398b97331e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:03:58.412124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8cd4b-9b03-4529-a945-e398b97331e4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:03:58.431368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 564/1136] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:03:58 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:04:00.773181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5091b-c7fc-4875-b3f0-1d9d70df2a28 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:00.773687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5091b-c7fc-4875-b3f0-1d9d70df2a28 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:00.773796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5091b-c7fc-4875-b3f0-1d9d70df2a28 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:00.775542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 573/1137] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:00.781434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:00.781888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:00.781975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:00.800383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:00.801541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:00.809067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 565/1138] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:00.832879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5091b-c7fc-4875-b3f0-1d9d70df2a28 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:00.844590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5091b-c7fc-4875-b3f0-1d9d70df2a28 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:00.850389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:00.851483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:00.851896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:00.852299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:00.863110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:04:00.869759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:04:00.870905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 574/1139] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:04:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:04:00.880913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:00.890656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e1b61-20fd-45d9-b630-31734ae944ec None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:00.895414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:00.896053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:00.896328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:00.896595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:00.897337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:00.897636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:00.899234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:00.910676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 566/1140] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:04:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:00.916752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:00.928579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef953ec-36f0-425a-9630-782833b4584c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:00.933589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:00.934419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:00.934778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:00.935189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] PATH_INFO: `/v3/users/4905d90df20741799978491f82d909e4` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:00.950324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] RBAC: Authorizing `identity:get_user(user_id=4905d90df20741799978491f82d909e4)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:00.952468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:00.954658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 575/1141] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:04:00 2021] GET /identity/v3/users/4905d90df20741799978491f82d909e4 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:00.960529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:00.969819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a29d-7e3d-4505-ba33-ce62062e489d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:00.974771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:00.975416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:00.975695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:00.975964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:00.983407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:00.985106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:00.994337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 567/1142] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:04:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:04:01.000253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:01.009465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2dd0-d16a-4cb1-8582-160ff0f7cbe8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:01.013884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4e38-5622-44b1-8c4b-3e06b910689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:01.014689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4e38-5622-44b1-8c4b-3e06b910689b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:01.014968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4e38-5622-44b1-8c4b-3e06b910689b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:01.015270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4e38-5622-44b1-8c4b-3e06b910689b admin admin] PATH_INFO: `/v3/projects/48bfedddbca14b979458d5ef9b3ec148` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:01.016427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4e38-5622-44b1-8c4b-3e06b910689b admin admin] RBAC: Authorizing `identity:get_project(project_id=48bfedddbca14b979458d5ef9b3ec148)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:01.018907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4e38-5622-44b1-8c4b-3e06b910689b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:01.020526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 576/1143] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:04:00 2021] GET /identity/v3/projects/48bfedddbca14b979458d5ef9b3ec148 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:01.026495 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:01.035439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e04084-4398-438f-9920-22107f89ce35 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:01.039874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:01.040459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:01.040733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:01.041000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:01.041800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=48bfedddbca14b979458d5ef9b3ec148, user.id=4905d90df20741799978491f82d909e4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:01.042102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:01.043915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a2dfc-1694-4bc5-bf13-31e919ffcb88 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:01.049007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 568/1144] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:04:01 2021] GET /identity/v3/role_assignments?user.id=4905d90df20741799978491f82d909e4&scope.project.id=48bfedddbca14b979458d5ef9b3ec148&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:03.326949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242b115-76a0-4f53-8a58-b9a2fcdbc1a0 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.327549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242b115-76a0-4f53-8a58-b9a2fcdbc1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.327549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242b115-76a0-4f53-8a58-b9a2fcdbc1a0 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.329318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 577/1145] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:03.335015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.335468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.335562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.352567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:03.353732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:03.361123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 569/1146] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:03.385812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242b115-76a0-4f53-8a58-b9a2fcdbc1a0 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:03.397622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242b115-76a0-4f53-8a58-b9a2fcdbc1a0 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:03.401882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:03.402627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.402903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.403213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.412915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:04:03.419507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:04:03.420608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 578/1147] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:04:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:04:03.427020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:03.435502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c2ba-1679-4172-8d6a-6ff705e5a7c2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:03.439884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:03.441130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.441402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.441668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.442405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:03.442702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:03.444298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:03.452175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 570/1148] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:04:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:03.457905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:03.467544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1e3fd-3e54-4836-a1d3-cce9be4e6489 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:03.471944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:03.472742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.473017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.473284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] PATH_INFO: `/v3/users/4905d90df20741799978491f82d909e4` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.474480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] RBAC: Authorizing `identity:get_user(user_id=4905d90df20741799978491f82d909e4)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:03.476571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:03.478081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 579/1149] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:04:03 2021] GET /identity/v3/users/4905d90df20741799978491f82d909e4 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:03.483626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:03.493233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d877c2-5e87-400e-8267-1eef8eefb4c4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:03.497625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea302db9-58b3-4720-a658-be9efee1ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:03.498418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea302db9-58b3-4720-a658-be9efee1ba4f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.498693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea302db9-58b3-4720-a658-be9efee1ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.498962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea302db9-58b3-4720-a658-be9efee1ba4f admin admin] PATH_INFO: `/v3/projects/48bfedddbca14b979458d5ef9b3ec148` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.500135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea302db9-58b3-4720-a658-be9efee1ba4f admin admin] RBAC: Authorizing `identity:get_project(project_id=48bfedddbca14b979458d5ef9b3ec148)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:03.502088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea302db9-58b3-4720-a658-be9efee1ba4f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:03.504326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 571/1150] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:04:03 2021] GET /identity/v3/projects/48bfedddbca14b979458d5ef9b3ec148 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:03.509851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:03.518699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3843b46-6e04-4544-b3fc-d52f21cb64bc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:03.523018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d98bff-cd68-434f-93be-e7b0728cbbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:03.523857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98bff-cd68-434f-93be-e7b0728cbbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:03.524133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98bff-cd68-434f-93be-e7b0728cbbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:03.524401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98bff-cd68-434f-93be-e7b0728cbbe3 admin admin] PATH_INFO: `/v3/projects/48bfedddbca14b979458d5ef9b3ec148/users/4905d90df20741799978491f82d909e4/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:03.526290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d98bff-cd68-434f-93be-e7b0728cbbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bfedddbca14b979458d5ef9b3ec148, user_id=4905d90df20741799978491f82d909e4, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:03.528883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d98bff-cd68-434f-93be-e7b0728cbbe3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:03.540925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 580/1151] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:04:03 2021] PUT /identity/v3/projects/48bfedddbca14b979458d5ef9b3ec148/users/4905d90df20741799978491f82d909e4/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:04:05.871282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92055fdb-e72d-493b-b45b-96b804c7c9b0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:05.871816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92055fdb-e72d-493b-b45b-96b804c7c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:05.871816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92055fdb-e72d-493b-b45b-96b804c7c9b0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:05.873604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 572/1152] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:05.879764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:05.880132 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:05.880316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:05.897363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:05.898534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:05.952864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 581/1153] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:05.976728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92055fdb-e72d-493b-b45b-96b804c7c9b0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:05.989455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92055fdb-e72d-493b-b45b-96b804c7c9b0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:05.993792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:05.994546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:05.994830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:05.995135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:06.005151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:04:06.011868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:04:06.012980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 573/1154] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:04:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:04:06.018875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:06.027465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a29b12-a78c-411e-9ece-14b7a6f27d58 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:06.032241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:06.032870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:06.033150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:06.033420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:06.034669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:06.034968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:06.036569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:06.044501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 582/1155] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:04:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:06.050803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:06.060505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fbcf6-31eb-484f-953f-3dc18c5df148 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:06.064954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:06.065751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:06.066033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:06.066308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] PATH_INFO: `/v3/users/4905d90df20741799978491f82d909e4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:06.067515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] RBAC: Authorizing `identity:get_user(user_id=4905d90df20741799978491f82d909e4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:06.069599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:06.071152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 574/1156] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:04:06 2021] GET /identity/v3/users/4905d90df20741799978491f82d909e4 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:06.076593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:06.085601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc12cc-419b-4d0b-8dfc-eb55169c2988 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:06.090019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:06.090606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:06.090886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:06.091202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:06.099152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:06.100827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:06.109262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 583/1157] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:04:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:04:06.115846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:06.124831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59181-94e0-402b-8633-4951d98bf59c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:06.129306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810dc8f-760e-4c0e-bfc9-292c1823513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:06.130107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810dc8f-760e-4c0e-bfc9-292c1823513e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:06.130386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810dc8f-760e-4c0e-bfc9-292c1823513e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:06.130659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810dc8f-760e-4c0e-bfc9-292c1823513e admin admin] PATH_INFO: `/v3/projects/48bfedddbca14b979458d5ef9b3ec148` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:06.131849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810dc8f-760e-4c0e-bfc9-292c1823513e admin admin] RBAC: Authorizing `identity:get_project(project_id=48bfedddbca14b979458d5ef9b3ec148)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:06.133844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810dc8f-760e-4c0e-bfc9-292c1823513e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:06.135466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 575/1158] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:04:06 2021] GET /identity/v3/projects/48bfedddbca14b979458d5ef9b3ec148 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:06.141189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:06.149513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65750f2-72eb-4699-aa5e-f94807147a66 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:06.153938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:06.154522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:06.154800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:06.155105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:06.155916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=48bfedddbca14b979458d5ef9b3ec148, user.id=4905d90df20741799978491f82d909e4) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:06.156220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:06.157981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf879aa0-05db-45fe-b782-5f18f9e32c8f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:06.164102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 584/1159] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:04:06 2021] GET /identity/v3/role_assignments?user.id=4905d90df20741799978491f82d909e4&scope.project.id=48bfedddbca14b979458d5ef9b3ec148&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:08.484125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6364-fd84-452a-9517-28f5fd588df6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:08.484758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6364-fd84-452a-9517-28f5fd588df6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:08.484758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6364-fd84-452a-9517-28f5fd588df6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:08.486423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 576/1160] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:08.493078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:08.493509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:08.493609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:08.511435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:08.512612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:08.520635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 585/1161] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:08.545190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6364-fd84-452a-9517-28f5fd588df6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:08.557020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6364-fd84-452a-9517-28f5fd588df6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:08.561271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:08.561878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:08.562154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:08.562422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:08.569808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:08.571560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:08.579998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 577/1162] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:04:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:04:08.586626 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:08.595389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708d987-07c9-4721-8374-d13a2e066bf6 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:08.600434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:08.601200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:08.601483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:08.601757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:08.608499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:08.610299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:08.624660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-14167406-9770-486c-a0fa-864c0e6c36b9 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 14 03:04:08.625783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 586/1163] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:04:08 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:04:08.632030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:08.640541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4f0a-bd53-4372-ae70-89967a9e1ec0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:08.645539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:08.646154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:08.646432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:08.646701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:08.647448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:08.647752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:08.649284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ae2c7-487d-488b-921e-0ef96155c195 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:08.656344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 578/1164] 10.222.0.43 () {56 vars in 1136 bytes} [Tue Dec 14 03:04:08 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:04:10.968136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562424b-f6fe-41b6-8136-ce0625599ca1 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:10.968658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562424b-f6fe-41b6-8136-ce0625599ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:10.968658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562424b-f6fe-41b6-8136-ce0625599ca1 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:10.970372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 587/1165] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:10.976116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5207cb0-d409-4eee-b710-a63fba03771c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:10.976491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5207cb0-d409-4eee-b710-a63fba03771c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:10.976674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5207cb0-d409-4eee-b710-a63fba03771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:10.994778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d5207cb0-d409-4eee-b710-a63fba03771c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:10.995985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d5207cb0-d409-4eee-b710-a63fba03771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:11.004115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 579/1166] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:11.027723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562424b-f6fe-41b6-8136-ce0625599ca1 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:11.039538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562424b-f6fe-41b6-8136-ce0625599ca1 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:11.043832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:11.044447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:11.044720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:11.044986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:11.045733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:11.046742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:04:11.046742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:04:11.046742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:04:11.047629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d85c10-7198-4be2-8f77-58fdab24daa9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:11.062241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 588/1167] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Dec 14 03:04:11 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:04:13.392523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dee20-0058-417c-b53f-961fd209f212 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:13.393691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dee20-0058-417c-b53f-961fd209f212 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:13.393691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dee20-0058-417c-b53f-961fd209f212 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:13.395433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 580/1168] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:13.401272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe417fc-3199-427d-befd-8890098b984a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:13.401713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe417fc-3199-427d-befd-8890098b984a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:13.401815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe417fc-3199-427d-befd-8890098b984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:13.418960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2fe417fc-3199-427d-befd-8890098b984a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:13.420150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2fe417fc-3199-427d-befd-8890098b984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:13.474777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 589/1169] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:04:13.499561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dee20-0058-417c-b53f-961fd209f212 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:13.512131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dee20-0058-417c-b53f-961fd209f212 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:13.516452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743f804-86f9-48cb-b012-4b0f886c63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:13.517273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743f804-86f9-48cb-b012-4b0f886c63db admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:13.517557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743f804-86f9-48cb-b012-4b0f886c63db admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:13.518437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743f804-86f9-48cb-b012-4b0f886c63db admin admin] PATH_INFO: `/v3/domains/d2044f108e4d460ba19c2ba84610aa8b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:13.528745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743f804-86f9-48cb-b012-4b0f886c63db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=d2044f108e4d460ba19c2ba84610aa8b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:13.530675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743f804-86f9-48cb-b012-4b0f886c63db admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:13.532274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 581/1170] 10.222.0.43 () {56 vars in 1204 bytes} [Tue Dec 14 03:04:13 2021] GET /identity/v3/domains/d2044f108e4d460ba19c2ba84610aa8b => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:13.538124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe417fc-3199-427d-befd-8890098b984a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:13.546571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe417fc-3199-427d-befd-8890098b984a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:13.550965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273bf9-8115-4b7f-b8a3-2c01a0412f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:13.551617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273bf9-8115-4b7f-b8a3-2c01a0412f21 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:13.551892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273bf9-8115-4b7f-b8a3-2c01a0412f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:13.552162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273bf9-8115-4b7f-b8a3-2c01a0412f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:13.552861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273bf9-8115-4b7f-b8a3-2c01a0412f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:13.554722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273bf9-8115-4b7f-b8a3-2c01a0412f21 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:13.579104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 590/1171] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:04:13 2021] POST /identity/v3/projects => generated 361 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:04:15.923144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47f24-0fe0-44c8-b892-d1d99ea3ed3c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:15.923654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47f24-0fe0-44c8-b892-d1d99ea3ed3c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:15.923654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47f24-0fe0-44c8-b892-d1d99ea3ed3c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:15.925994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 582/1172] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:15.931696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:15.932086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:15.932260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:15.949983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:15.951215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:16.006054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 591/1173] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:16.031898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47f24-0fe0-44c8-b892-d1d99ea3ed3c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:16.044427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47f24-0fe0-44c8-b892-d1d99ea3ed3c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:16.048902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3430-4f2c-499b-abb0-f10f231274d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:16.049745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3430-4f2c-499b-abb0-f10f231274d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:16.050028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3430-4f2c-499b-abb0-f10f231274d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:16.050300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3430-4f2c-499b-abb0-f10f231274d8 admin admin] PATH_INFO: `/v3/domains/d2044f108e4d460ba19c2ba84610aa8b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:16.051509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf3430-4f2c-499b-abb0-f10f231274d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=d2044f108e4d460ba19c2ba84610aa8b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:16.053421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf3430-4f2c-499b-abb0-f10f231274d8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:16.054973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 583/1174] 10.222.0.43 () {56 vars in 1204 bytes} [Tue Dec 14 03:04:16 2021] GET /identity/v3/domains/d2044f108e4d460ba19c2ba84610aa8b => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:16.060744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:16.069341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcb7ae-d16e-48aa-9a86-131ebdf640ac None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:16.073835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eda2ec-181c-4a87-a28d-da7057baa582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:16.074470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eda2ec-181c-4a87-a28d-da7057baa582 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:16.074751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eda2ec-181c-4a87-a28d-da7057baa582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:16.075023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eda2ec-181c-4a87-a28d-da7057baa582 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:16.075772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eda2ec-181c-4a87-a28d-da7057baa582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:16.077645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eda2ec-181c-4a87-a28d-da7057baa582 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:16.097568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 592/1175] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:04:16 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:04:18.451782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6a69-39cd-4c7e-98cc-79f5c9336f34 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.452306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6a69-39cd-4c7e-98cc-79f5c9336f34 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.452394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6a69-39cd-4c7e-98cc-79f5c9336f34 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.454089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 584/1176] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:18.459661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.460115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.460210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.477182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:18.478356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:18.485760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 593/1177] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:18.510046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f6a69-39cd-4c7e-98cc-79f5c9336f34 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:18.521904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f6a69-39cd-4c7e-98cc-79f5c9336f34 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:18.526222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:18.526964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.527269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.527539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.537774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:04:18.544427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:04:18.545540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 585/1178] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:04:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:04:18.551981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:18.560504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b914b-c48c-4c60-8ddc-a991851f63a8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:18.565495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:18.566118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.566391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.566654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.567431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:18.567729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:18.569298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:18.577105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 594/1179] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:04:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:18.582907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:18.592051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db638f3-d3cd-420f-863e-1c407d418f46 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:18.596485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:18.597290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.597570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.597844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] PATH_INFO: `/v3/users/496ea9ac50fe4855a12fe9d18f7fff9d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.612103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] RBAC: Authorizing `identity:get_user(user_id=496ea9ac50fe4855a12fe9d18f7fff9d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:18.614444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:18.616030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 586/1180] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:04:18 2021] GET /identity/v3/users/496ea9ac50fe4855a12fe9d18f7fff9d => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:18.621750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:18.631433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928f7f0-7080-4295-9980-1d96565e211f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:18.635811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:18.636408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.636682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.636947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.644331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:18.646019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:18.654436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 595/1181] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:04:18 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:04:18.660815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:18.670144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0939911-ac1b-4afb-834e-fe10341f8fa0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:18.675281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cbdf5-ae2f-4767-acff-9fd6eb88edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:18.676106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cbdf5-ae2f-4767-acff-9fd6eb88edd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.676386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cbdf5-ae2f-4767-acff-9fd6eb88edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.676658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cbdf5-ae2f-4767-acff-9fd6eb88edd2 admin admin] PATH_INFO: `/v3/projects/3307ee6a2d5245e5adf14e1719a6870f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.677828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cbdf5-ae2f-4767-acff-9fd6eb88edd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3307ee6a2d5245e5adf14e1719a6870f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:18.679880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cbdf5-ae2f-4767-acff-9fd6eb88edd2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:18.681501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 587/1182] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:04:18 2021] GET /identity/v3/projects/3307ee6a2d5245e5adf14e1719a6870f => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:04:18.687552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:18.696056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d87ad-bfb8-4109-999d-7059915626fd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:18.700508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:18.701114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:18.701390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:18.701658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:18.702522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=3307ee6a2d5245e5adf14e1719a6870f, user.id=496ea9ac50fe4855a12fe9d18f7fff9d) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:18.702780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:18.704610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff581340-a5cf-4de8-97a4-418e1074b4ff admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:18.709795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 596/1183] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:04:18 2021] GET /identity/v3/role_assignments?user.id=496ea9ac50fe4855a12fe9d18f7fff9d&scope.project.id=3307ee6a2d5245e5adf14e1719a6870f&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:21.026012 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94043-c39e-4bb1-9c14-3162629b5418 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.026522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94043-c39e-4bb1-9c14-3162629b5418 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.026522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94043-c39e-4bb1-9c14-3162629b5418 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.028242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 588/1184] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:21.033870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.034306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.034410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.051479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:21.052643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:21.060065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 597/1185] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:21.083628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf94043-c39e-4bb1-9c14-3162629b5418 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:21.095142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf94043-c39e-4bb1-9c14-3162629b5418 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:21.099373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:21.100110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.100383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.100650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.110307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:04:21.117181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:04:21.118277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 589/1186] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:04:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:04:21.124237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:21.133237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087eada-5ac6-4b48-8271-7f9df26f3b87 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:21.137643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:21.138268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.138548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.138820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.139613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:21.139916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:21.141500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:21.149841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 598/1187] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:04:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:21.155654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:21.164689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757862d-7ee3-49bf-9133-78ae7390cd41 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:21.169038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:21.169875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.170151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.170421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] PATH_INFO: `/v3/users/496ea9ac50fe4855a12fe9d18f7fff9d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.171612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] RBAC: Authorizing `identity:get_user(user_id=496ea9ac50fe4855a12fe9d18f7fff9d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:21.173673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:21.175217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 590/1188] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:04:21 2021] GET /identity/v3/users/496ea9ac50fe4855a12fe9d18f7fff9d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:21.180879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:21.190430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07093f-54a2-4e73-9a0c-96764f775296 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:21.194845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706bea-7017-4b6e-8b22-a3207fd33a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:21.195676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706bea-7017-4b6e-8b22-a3207fd33a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.195959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706bea-7017-4b6e-8b22-a3207fd33a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.196232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706bea-7017-4b6e-8b22-a3207fd33a39 admin admin] PATH_INFO: `/v3/projects/3307ee6a2d5245e5adf14e1719a6870f` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.197387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706bea-7017-4b6e-8b22-a3207fd33a39 admin admin] RBAC: Authorizing `identity:get_project(project_id=3307ee6a2d5245e5adf14e1719a6870f)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:21.199408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706bea-7017-4b6e-8b22-a3207fd33a39 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:21.201115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 599/1189] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:04:21 2021] GET /identity/v3/projects/3307ee6a2d5245e5adf14e1719a6870f => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:21.207278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:21.216774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c95cc3-b196-4ac6-ba88-e3f323ea54cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:21.221176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea3589-0667-4dfa-a7cc-e9f956b504ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:21.221993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3589-0667-4dfa-a7cc-e9f956b504ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:21.222268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3589-0667-4dfa-a7cc-e9f956b504ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:21.222538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3589-0667-4dfa-a7cc-e9f956b504ff admin admin] PATH_INFO: `/v3/projects/3307ee6a2d5245e5adf14e1719a6870f/users/496ea9ac50fe4855a12fe9d18f7fff9d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:21.224487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3589-0667-4dfa-a7cc-e9f956b504ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3307ee6a2d5245e5adf14e1719a6870f, user_id=496ea9ac50fe4855a12fe9d18f7fff9d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:21.227028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3589-0667-4dfa-a7cc-e9f956b504ff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:21.240694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 591/1190] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:04:21 2021] PUT /identity/v3/projects/3307ee6a2d5245e5adf14e1719a6870f/users/496ea9ac50fe4855a12fe9d18f7fff9d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:04:23.568158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afad259-21a9-4a74-81a0-141be3a77314 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.568744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afad259-21a9-4a74-81a0-141be3a77314 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.568744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afad259-21a9-4a74-81a0-141be3a77314 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.570458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 600/1191] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:04:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:04:23.576208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.576612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.576752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.594192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:04:23.595387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:04:23.653512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 592/1192] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:04:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:04:23.678048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afad259-21a9-4a74-81a0-141be3a77314 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:23.689998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afad259-21a9-4a74-81a0-141be3a77314 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:23.694395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:23.695183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.695465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.695740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.706041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:04:23.712691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:04:23.713806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 601/1193] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:04:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:04:23.719822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:23.728950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10336754-be87-44eb-b119-d6c6d09f13e9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:23.733359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:23.733989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.734268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.734537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.735318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:23.735620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:23.737203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:23.745364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 593/1194] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:04:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:23.751246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:23.760921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6c3bb-5787-4819-bf60-2ad8ada8bf02 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:23.765326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:23.766119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.766395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.766663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] PATH_INFO: `/v3/users/496ea9ac50fe4855a12fe9d18f7fff9d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.768366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] RBAC: Authorizing `identity:get_user(user_id=496ea9ac50fe4855a12fe9d18f7fff9d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:23.770437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:23.772017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 602/1195] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Dec 14 03:04:23 2021] GET /identity/v3/users/496ea9ac50fe4855a12fe9d18f7fff9d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:23.777552 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:23.787520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3283582-dcf5-448f-b13b-4758ab617cf4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:23.792008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:23.792613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.792896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.793170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.800690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:23.802433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:23.811220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 594/1196] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:04:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:04:23.816730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:23.825794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4b1e1-3351-4918-b4d2-71190a67667c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:23.830664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f4a7-3722-4f8b-a3e3-f07633e8a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:23.831468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f4a7-3722-4f8b-a3e3-f07633e8a1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.831749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f4a7-3722-4f8b-a3e3-f07633e8a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.832020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f4a7-3722-4f8b-a3e3-f07633e8a1a8 admin admin] PATH_INFO: `/v3/projects/3307ee6a2d5245e5adf14e1719a6870f` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.833173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f4a7-3722-4f8b-a3e3-f07633e8a1a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3307ee6a2d5245e5adf14e1719a6870f)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:23.835170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f4a7-3722-4f8b-a3e3-f07633e8a1a8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:23.836764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 603/1197] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:04:23 2021] GET /identity/v3/projects/3307ee6a2d5245e5adf14e1719a6870f => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:04:23.842400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:04:23.851241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4213-7050-4dca-9799-2f93435e0537 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:04:23.855752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:04:23.856341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:04:23.856627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:04:23.856904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:04:23.857715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=3307ee6a2d5245e5adf14e1719a6870f, user.id=496ea9ac50fe4855a12fe9d18f7fff9d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:04:23.858022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:04:23.859821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4c45-e191-49ed-aedd-ac841e8adc2c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:04:23.865750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 595/1198] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:04:23 2021] GET /identity/v3/role_assignments?user.id=496ea9ac50fe4855a12fe9d18f7fff9d&scope.project.id=3307ee6a2d5245e5adf14e1719a6870f&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:21.831179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a1de-51b2-479b-9cdd-8e0125bc40c8 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:21.831807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a1de-51b2-479b-9cdd-8e0125bc40c8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:21.831807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a1de-51b2-479b-9cdd-8e0125bc40c8 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:21.833852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 604/1199] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:21.845422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:21.845422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:21.845422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:21.870865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:21.872456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:21.886729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 596/1200] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:21.919537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a1de-51b2-479b-9cdd-8e0125bc40c8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:21.934090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a1de-51b2-479b-9cdd-8e0125bc40c8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:21.939520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:21.940333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:21.940703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:21.940977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:21.958267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:21.960251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:21.980942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:21.982361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 605/1201] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:21.990088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:22.003521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c91c2-0fa0-441a-bafb-c3629ba54d88 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:22.008670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:22.009451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:22.009843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:22.010213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:22.011075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:22.011493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:22.013164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2d818-516f-4aeb-9cd3-459bfecef7c8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:22.025657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 597/1202] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:05:22.031450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:22.042803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6803c-c710-4abc-8a7f-4539f42b0156 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:22.049011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8c319-9470-49b1-ac93-7d1fc074b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:22.049844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8c319-9470-49b1-ac93-7d1fc074b122 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:22.050255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8c319-9470-49b1-ac93-7d1fc074b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:22.050611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8c319-9470-49b1-ac93-7d1fc074b122 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:22.051476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8c319-9470-49b1-ac93-7d1fc074b122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:22.053806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8c319-9470-49b1-ac93-7d1fc074b122 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:22.081291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 606/1203] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Dec 14 03:05:22 2021] POST /identity/v3/users => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:05:24.558883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ed5a3-986f-4bd9-83f7-25ed0a1f9280 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.559563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ed5a3-986f-4bd9-83f7-25ed0a1f9280 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.559563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ed5a3-986f-4bd9-83f7-25ed0a1f9280 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.561522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 598/1204] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:24.566908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.567393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.567479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.586187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:24.587334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:24.596108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 607/1205] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:24.619863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ed5a3-986f-4bd9-83f7-25ed0a1f9280 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.632725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ed5a3-986f-4bd9-83f7-25ed0a1f9280 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.639441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.640857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.641136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.641405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.652364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:05:24.660548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:05:24.661102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 599/1206] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:24.667260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.678811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518cad6-5154-481a-be55-235281f4cee3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.684670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.685761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.685761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.686088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.687456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:24.687848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.689563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.698476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 608/1207] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:24.705538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.715924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93b557-f0e6-47db-9975-e7c42f6c7cf8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.720924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.721715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.721971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.722238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.732715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.734562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.752784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:24.754157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 600/1208] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:24.760592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.772457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9e8e-f010-49ef-a362-afe7cba6ae79 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.777932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.778636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.778941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.779274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.780795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:24.780795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.782082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.794384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 609/1209] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:24.800788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.813325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515a6f-0687-4961-b75e-2a31625fc380 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.820175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.820951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.821232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.821507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.830376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.832500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.847385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 14 03:05:24.850840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 601/1210] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:24.855026 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.865571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d26e-7791-41ca-91b3-b1d34916dd82 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.870590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.872048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.872048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.872048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.872735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:24.873124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.875695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.895185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 610/1211] 10.222.0.43 () {56 vars in 1164 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:05:24.901719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.912001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79353e3-1543-4b7b-be35-3f0243b5ee3a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.916910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.917535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.917834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.918151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.926811 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.928566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.938668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 602/1212] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:05:24.945711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:24.956479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5cb9-2667-425c-a2c7-71c23a505c19 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:24.961577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:24.962485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:24.962894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:24.963287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:24.977146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:24.979120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:24.997582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:24.998907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 611/1213] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:25.005113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:25.014240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d20cc-4880-4bab-b519-f31f5732e934 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:25.019783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:25.020367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:25.020647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:25.020918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:25.021634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:25.021934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:25.023701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:25.036148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 603/1214] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:25.042244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:25.053302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f7802-70ef-4a29-ae9a-a12f11bbce81 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:25.058316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:25.059189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:25.059522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:25.059857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:25.067864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:25.069773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:25.083564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:05:25.084784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 612/1215] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:05:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:25.091448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:25.102199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f658aa-28d3-4b08-97bf-37f0fa96b260 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:25.109229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:25.109867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:25.110148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:25.110425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:25.111244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:25.111549 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:25.113657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417f401-ac26-4d07-a888-3757081ce94f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:25.126434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 604/1216] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:05:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:25.133017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:25.147587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab47eb-235d-47af-b3d3-e090c55230b2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:25.153519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:25.154444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:25.154955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:25.155368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:25.157117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8ae3d39ccc094e7db89711d3f52701f0) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:25.157468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:25.159807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53957db-278f-43a2-a6f0-979f7408b576 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:25.167410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 613/1217] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:05:25 2021] GET /identity/v3/role_assignments?user.id=8ae3d39ccc094e7db89711d3f52701f0&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:27.571891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8623b-573c-4e6a-90a2-455947d391d1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.572501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8623b-573c-4e6a-90a2-455947d391d1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.572501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8623b-573c-4e6a-90a2-455947d391d1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.574200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 605/1218] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:27.580077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.580511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.580615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.598552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:27.599953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:27.609162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 614/1219] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:27.633528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8623b-573c-4e6a-90a2-455947d391d1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.646430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8623b-573c-4e6a-90a2-455947d391d1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.650836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.651657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.651941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.652209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.673186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:05:27.681607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:05:27.687469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 606/1220] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:27.690271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.700718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88c3a-cee1-4146-96d9-e7bbb5720833 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.707384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.708066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.708341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.708606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.709395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:27.709662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.711417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:27.724978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 615/1221] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:27.731497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.742678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71bcaf-ace3-40ae-9f9f-66280066373f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.747156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.747945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.748219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.748489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.759132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.761187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:27.778589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:27.779788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 607/1222] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:27.787021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.798095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70c06-0fdc-40c7-a56d-7f7e84d35645 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.804583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.805332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.805638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.805965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.806703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:27.807079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.808696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:27.822933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 616/1223] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:27.829469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.839794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ab73f-99e2-495b-9ae5-31ca760de053 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.844862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.845638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.845914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.846184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.853476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.855583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:27.871180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 14 03:05:27.872381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 608/1224] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:27.878936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.888613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17d211-eee8-43a7-8c7b-66d336e83948 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.893124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.893768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.894049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.894324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.895207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:27.895516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.897344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:27.915634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 617/1225] 10.222.0.43 () {56 vars in 1164 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:27.922292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.932080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb54a-0b1c-457c-b836-3ee3d42b20c6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.936969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.937936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.938228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.938571 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.949297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.951125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:27.968643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:27.969803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 609/1226] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:27.975982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:27.986068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7548-2d07-47f3-b64a-4d62d94702c2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:27.991663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:27.992325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:27.992608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:27.992919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:27.993629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:27.993949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:27.995580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:28.007452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 618/1227] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:28.013895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:28.024044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb16afd-1411-4abb-94b7-fbd343019152 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:28.028747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:28.029504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:28.029796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:28.030060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:28.037631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:28.039629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:28.052610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:05:28.054012 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 610/1228] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:05:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:28.060390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:28.070585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04a084-e350-4629-be16-848f2f3b1feb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:28.075635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:28.076345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:28.076624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:28.076897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:28.078283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:28.078670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:28.080815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3addc-ebc9-4f04-8dfb-8f9b71082d48 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:28.094577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 619/1229] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:05:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:28.101018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:28.114482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2683-60fa-451c-bf46-6999408de897 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:28.119508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379a3fe-826c-4388-b35e-5d65b6dd0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:28.120441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379a3fe-826c-4388-b35e-5d65b6dd0778 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:28.120744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379a3fe-826c-4388-b35e-5d65b6dd0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:28.121066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379a3fe-826c-4388-b35e-5d65b6dd0778 admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8ae3d39ccc094e7db89711d3f52701f0/roles/2fe040230af948b08ee4b79b4e5f2177` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:28.136584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379a3fe-826c-4388-b35e-5d65b6dd0778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=8ae3d39ccc094e7db89711d3f52701f0, role_id=2fe040230af948b08ee4b79b4e5f2177)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:28.139514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379a3fe-826c-4388-b35e-5d65b6dd0778 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:28.153300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 611/1230] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:05:28 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8ae3d39ccc094e7db89711d3f52701f0/roles/2fe040230af948b08ee4b79b4e5f2177 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:05:30.549183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dcbec-ac3a-4b9e-9802-abc6afe3eaf4 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.549765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dcbec-ac3a-4b9e-9802-abc6afe3eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.549765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dcbec-ac3a-4b9e-9802-abc6afe3eaf4 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.551531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 620/1231] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:30.559588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.560056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.560156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.578390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:30.579604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:30.638861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 612/1232] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:30.669841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dcbec-ac3a-4b9e-9802-abc6afe3eaf4 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.682555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dcbec-ac3a-4b9e-9802-abc6afe3eaf4 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.687804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.688569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.688838 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.689105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.700647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:05:30.707963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 14 03:05:30.709214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 621/1233] 10.222.0.43 () {56 vars in 1123 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:30.715532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.724198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c933e1-feb8-494a-aa35-634ff5dc6832 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.729396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.730055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.730362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.730606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.731412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:30.731713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:30.733397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:30.742046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 613/1234] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:30.748330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.759194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb782b-acf9-4b0f-a6dc-692d22cb760d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.763850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.764612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.764995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.765774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.776165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:30.778000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:30.796910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:30.798574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 622/1235] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:30.804749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.815287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9e1a-3f6e-4118-86e1-bb07a82d046c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.820316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.821056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.821372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.821642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.822413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:30.822738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:30.824491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:30.836736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 614/1236] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:30.842921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.852688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e191ba-2169-4f14-9834-b380be8a8a91 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.857377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.858149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.858447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.858720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.866317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:30.868319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:30.882472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 14 03:05:30.883694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 623/1237] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:30.890466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.900159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd392af-69a7-4215-8aa7-591065f83537 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.905337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.905999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.906277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.906546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.907410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:30.907713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:30.909516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:30.927412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 615/1238] 10.222.0.43 () {56 vars in 1164 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:30.933542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.943740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67ba5-e48a-4656-be55-007040cdd8fa admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.948594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.949219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.949496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.949768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:30.959809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:30.961559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:30.970635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 624/1239] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:05:30.976764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:30.987201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3691b-edb0-48f9-a341-d18022e4676c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:30.992024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:30.992787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:30.993074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:30.993344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:31.004137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:31.006008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:31.025800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:31.027554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 616/1240] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:31.033711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:31.044242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cfab8-8bad-40a7-8e6d-ad33158f9eef admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:31.050553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:31.051326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:31.051610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:31.051890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:31.052770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:31.053119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:31.055238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:31.068488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 625/1241] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:31.074668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:31.085546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c2af-6278-4c25-a080-17a17c5ca835 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:31.090200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:31.090969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:31.091277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:31.091551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:31.098535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:31.100497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:31.114280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:05:31.115450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 617/1242] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:05:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:31.121808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:31.132252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f298490-0122-4e5e-8276-ebd9c0f38e8c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:31.137476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:31.138209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:31.138519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:31.138795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:31.140383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:31.140755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:31.142893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce4aeb-f017-44fa-9664-cfb5df2475b9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:31.162537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 626/1243] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:05:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:31.163827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:31.174473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f982a-510b-4f08-af3f-aeb891f9638e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:31.179372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:31.179994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:31.180273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:31.180545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:31.181402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] RBAC: Adding query filter params (role.id=2fe040230af948b08ee4b79b4e5f2177, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8ae3d39ccc094e7db89711d3f52701f0) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:31.181708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:31.183561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430682c1-5268-46af-af4c-9b4fc9a3c6cd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:31.189687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 618/1244] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:05:31 2021] GET /identity/v3/role_assignments?user.id=8ae3d39ccc094e7db89711d3f52701f0&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=2fe040230af948b08ee4b79b4e5f2177 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:33.748505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a39536-3299-4c0d-89a1-b6c3fbf31ed9 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:33.749058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a39536-3299-4c0d-89a1-b6c3fbf31ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:33.749058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a39536-3299-4c0d-89a1-b6c3fbf31ed9 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:33.750985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 627/1245] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:33.757050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:33.757540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:33.757653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:33.775288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:33.776455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:33.785155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 619/1246] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:33.809221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a39536-3299-4c0d-89a1-b6c3fbf31ed9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:33.821677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a39536-3299-4c0d-89a1-b6c3fbf31ed9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:33.827289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:33.828305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:33.828634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:33.828990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:33.839909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:05:33.847027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:05:33.848207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 628/1247] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:05:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:33.855533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:33.866298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8b65-e3bf-421a-bc96-4b05fc1f5d5f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:33.871578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:33.872263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:33.872601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:33.872935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:33.873651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:33.874061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:33.875777 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:33.885462 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 620/1248] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:05:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:33.892038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:33.903284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a160284-a420-4b84-9de0-ee318db9b5a0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:33.908246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:33.908998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:33.909275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:33.909544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:33.919453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:33.922227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:33.940521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:33.941719 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 629/1249] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:33.948385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:33.959638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394bf0-79d3-48ce-b176-4184c9737dee admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:33.965568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:33.966330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:33.966678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:33.967049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:33.968479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:33.968859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:33.970534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:33.984992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 621/1250] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:33.992522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.006518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7910d4-fc03-4f45-9a0a-2df33156bbde admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.012979 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.014287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.015351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.015823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.027192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.029405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.046911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 14 03:05:34.048632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 630/1251] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:33 2021] GET /identity/v3/users/placement => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:34.054893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.066330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b73e1-9a75-49cc-8438-2f936b9d5dfd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.070964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.071730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.072030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.072399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.073353 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:34.073665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.075807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.100908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 622/1252] 10.222.0.43 () {56 vars in 1164 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:34.102252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.112057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8afc50-c3cc-4a9c-9797-8140121ce093 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.117526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.118150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.118433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.118702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.126666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.128513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.139173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 631/1253] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:05:34.146348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.157704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a4b2d-23a3-4b35-b4a3-349e1de52d9c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.162422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.163225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.163501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.163772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.176981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.178875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.195760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:34.196939 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 623/1254] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:34.203735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.212985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8dbf6-031e-4284-94c5-0bcef732536e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.219157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.219852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.220169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.220445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.221262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:34.221566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.223184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.235403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 632/1255] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:34.242745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.253501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64068fb-a725-4697-a5ce-44d7f24f5082 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.258153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.258916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.259232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.259510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.267660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.269770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.285154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:05:34.286445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 624/1256] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:34.293701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.304807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd9f0e-f907-4dba-bbb1-8aa19e92cdf7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.310410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.311096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.311402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.311664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.312557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:34.312557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.314716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982805b4-10c5-4861-9f4c-b09778606930 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.328869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 633/1257] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:34.336143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:34.350653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7427c7-1a79-4c21-b6f9-ec84d7c602cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:34.356852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:34.357559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:34.357904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:34.358332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:34.359217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8ae3d39ccc094e7db89711d3f52701f0) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:34.359531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:34.361404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21d2c-2c15-49cb-adee-efc394636793 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:34.368006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 625/1258] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:05:34 2021] GET /identity/v3/role_assignments?user.id=8ae3d39ccc094e7db89711d3f52701f0&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:36.882487 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf824d-276a-4a4b-a19d-5655a59e24c9 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:36.883085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf824d-276a-4a4b-a19d-5655a59e24c9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:36.883194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf824d-276a-4a4b-a19d-5655a59e24c9 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:36.885030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 634/1259] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:36.890996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:36.891515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:36.891708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:36.911788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:36.913567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:36.923386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 626/1260] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:36.956740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf824d-276a-4a4b-a19d-5655a59e24c9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:36.969965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf824d-276a-4a4b-a19d-5655a59e24c9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:36.975713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:36.976610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:36.976863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:36.977145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:36.992415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:05:37.002140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:05:37.003954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 635/1261] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:05:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:37.011911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.021434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950b71b-9489-4b0a-a5c0-929b4a2e95bc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.026042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.026758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.027067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.027413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.028305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:37.028641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.030935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.040398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 627/1262] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:37.046806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.057618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f913aa-73ae-4b5d-ba9f-ede75e56666e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.062476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.063385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.064177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.064177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.076134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.078745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.098163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:37.099372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 636/1263] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:37.106404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.116257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee546a2-5d1a-4881-8141-4b86f1534f67 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.121675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.122312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.122592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.122863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.123634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:37.123952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.125539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.138548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 628/1264] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:37.146100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.156440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332315d8-0eed-4f72-899c-bbbe697c68b8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.160972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.161771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.162060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.162282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.171384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.173522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.188663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 14 03:05:37.189844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 637/1265] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:37.196351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.208048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bc94-e72f-4fc1-bce8-fa29d34110c2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.213248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.214055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.214377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.214688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.215711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:37.216095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.218742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.238331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 629/1266] 10.222.0.43 () {56 vars in 1164 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:37.244521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.254784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768354-3a63-4470-a52f-223c55848bda admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.259661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.260431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.260758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.261081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.273402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.275607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.296090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:37.297485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 638/1267] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 14 03:05:37.303899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.313832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92d6d9-b9e2-4da4-bda9-05e984e25335 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.318708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.319402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.319686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.319958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.320719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:37.321067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.322580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.335508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 630/1268] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:05:37.344077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.355420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8781-f6c9-4cc1-a18b-aa02b8033b1c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.362010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.363217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.363518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.363818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.372497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.375313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.393329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:05:37.394903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 639/1269] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:37.401899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.413918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830d95-514d-40e2-bf58-bf2bd9e00b17 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.418822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.419519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.419788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.420061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.420870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:37.421176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.422995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d52bea-1bf4-4c75-a7f8-22ec321bd369 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.435752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 631/1270] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:05:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:37.443520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:37.455590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855f08-893c-43b6-bc0f-ba494e371fd5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:37.460757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25b6bc-e445-42b0-a398-3d5cff095dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:37.461786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b6bc-e445-42b0-a398-3d5cff095dae admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:37.462131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b6bc-e445-42b0-a398-3d5cff095dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:37.462407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b6bc-e445-42b0-a398-3d5cff095dae admin admin] PATH_INFO: `/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8ae3d39ccc094e7db89711d3f52701f0/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:37.464923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25b6bc-e445-42b0-a398-3d5cff095dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78979415294e85b114e4b58915a9fe, user_id=8ae3d39ccc094e7db89711d3f52701f0, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:37.467773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25b6bc-e445-42b0-a398-3d5cff095dae admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:37.482840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 640/1271] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Dec 14 03:05:37 2021] PUT /identity/v3/projects/0a78979415294e85b114e4b58915a9fe/users/8ae3d39ccc094e7db89711d3f52701f0/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:05:39.969831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21278-cf5e-4133-b3e0-00677a1b8172 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:39.970346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21278-cf5e-4133-b3e0-00677a1b8172 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:39.970346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21278-cf5e-4133-b3e0-00677a1b8172 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:39.972097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 632/1272] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:39.977533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:39.977920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:39.978070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:39.995783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:39.996963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:40.050735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 641/1273] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:40.074594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21278-cf5e-4133-b3e0-00677a1b8172 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.086442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21278-cf5e-4133-b3e0-00677a1b8172 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.090770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.091555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.091839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.092112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.101995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 14 03:05:40.109260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 14 03:05:40.110376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 633/1274] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:40.116371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.125444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a8dd2-5b1b-4989-9822-393fe7c36e49 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.129835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.130457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.130730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.130998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.132079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:40.133481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.135071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.142943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 642/1275] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:40.148773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.158527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92025e86-84ed-451d-9638-44e44fa39a69 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.163001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.163834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.164119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.164396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.174750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.176587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.193288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:40.194386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 634/1276] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:40.200060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.209161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f10dc5-1f0e-4d83-9f77-7d42fdb748d2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.213542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.214154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.214433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.214704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.215446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:40.215749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.217291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.228497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 643/1277] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:40.234522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.243823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ccbe5-4987-4ca8-9f04-838b61d6385e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.248198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.249541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.249816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.250083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.257009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.258947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.272221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 14 03:05:40.273290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 635/1278] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/users/placement => generated 87 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:40.278894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.288022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea8ac-7be1-4001-b721-0899c618e656 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.292504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.293128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.293405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.293678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.294492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:40.294793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.297139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.314042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 644/1279] 10.222.0.43 () {56 vars in 1164 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:40.320231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.332870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41378f44-6d8b-4b05-9471-d581db878d61 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.339285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.340120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.340529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.340902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.350404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.352725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.363398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 636/1280] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:05:40.369525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.379743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e6049-a80b-4784-b4a8-abd63ad641a5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.384702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.385652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.386027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.386316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.398802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.401275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.419849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 14 03:05:40.421618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 645/1281] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:40.427836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.436399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d9733-5ea3-4ee7-bfee-f549a4140f7b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.440861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.441480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.441757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.442023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.442728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:40.443024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.444596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.455386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 637/1282] 10.222.0.43 () {56 vars in 1130 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:40.460972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.470811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf34a4-ab81-4f8b-8d0b-dcc577411c31 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.475325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.476066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.476345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.476622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.483926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.485786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.498548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING keystone.server.flask.application [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 14 03:05:40.499687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 646/1283] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:40.505625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.514782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08c5f3-62c2-4382-b338-372547575225 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.519206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.519823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.520100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.520369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.521136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:40.521436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.523253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866dab6-3a62-4d90-898d-7b6dcbdbbb9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.535288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 638/1284] 10.222.0.43 () {56 vars in 1169 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:40.541120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:40.551576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de0218-6e67-444e-8cde-6684eea5b30e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:40.556065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:40.556660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:40.556939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:40.557213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:40.558032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] RBAC: Adding query filter params (role.id=fcf4cbc18cf54532a9afbff30f1453b0, scope.project.id=0a78979415294e85b114e4b58915a9fe, user.id=8ae3d39ccc094e7db89711d3f52701f0) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:40.558337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:40.560159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5465-8f04-4c48-a0bd-6ea8415ea2d5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:40.565713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 647/1285] 10.222.0.43 () {56 vars in 1395 bytes} [Tue Dec 14 03:05:40 2021] GET /identity/v3/role_assignments?user.id=8ae3d39ccc094e7db89711d3f52701f0&scope.project.id=0a78979415294e85b114e4b58915a9fe&role.id=fcf4cbc18cf54532a9afbff30f1453b0 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:42.899365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4751-b828-4974-80dd-efada6b3e7bd None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:42.899881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4751-b828-4974-80dd-efada6b3e7bd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:42.899969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4751-b828-4974-80dd-efada6b3e7bd None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:42.901676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 639/1286] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:42.907353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:42.907745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:42.907914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:42.925085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:42.926206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:42.933745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 648/1287] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:42.956977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4751-b828-4974-80dd-efada6b3e7bd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:42.968809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4751-b828-4974-80dd-efada6b3e7bd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:42.973176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:42.973931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:42.974214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:42.974488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:42.975172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:42.976749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:42.988176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 14 03:05:42.989295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 640/1288] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:05:42 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:42.995151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:43.004353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb33f-844d-445e-a885-1f6c15cf6331 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:43.008830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:43.009457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:43.009742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:43.010019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:43.010723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:43.011026 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:43.012623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b874-3907-48c2-992d-fd925a05cc17 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:43.017248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 649/1289] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Dec 14 03:05:42 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:43.022824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:43.031867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca6be-831a-431c-adb4-e2503d9efbf9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:43.036321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:43.036923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:43.037205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:43.037480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:43.038173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:43.038477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:43.040037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b526c40-3784-4edd-9af3-1aa6c1cb479d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:43.044390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 641/1290] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Dec 14 03:05:43 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:45.390128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8810335-ec24-43c5-b3ba-94c9d18bc26d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:45.390795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8810335-ec24-43c5-b3ba-94c9d18bc26d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:45.390795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8810335-ec24-43c5-b3ba-94c9d18bc26d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:45.392827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 650/1291] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:45.399508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a17e-0430-4659-ad59-67207b3c6bef None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:45.399936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a17e-0430-4659-ad59-67207b3c6bef None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:45.400206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a17e-0430-4659-ad59-67207b3c6bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:45.420932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bdc6a17e-0430-4659-ad59-67207b3c6bef None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:45.422270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bdc6a17e-0430-4659-ad59-67207b3c6bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:45.431421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 642/1292] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:45.456978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8810335-ec24-43c5-b3ba-94c9d18bc26d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:45.469393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8810335-ec24-43c5-b3ba-94c9d18bc26d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:45.473650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1e4d-7d2b-49d3-9356-2eeb1d3b8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:45.474274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1e4d-7d2b-49d3-9356-2eeb1d3b8fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:45.474550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1e4d-7d2b-49d3-9356-2eeb1d3b8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:45.474820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1e4d-7d2b-49d3-9356-2eeb1d3b8fb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:45.475564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b1e4d-7d2b-49d3-9356-2eeb1d3b8fb4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:45.477125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b1e4d-7d2b-49d3-9356-2eeb1d3b8fb4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:45.489578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 651/1293] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Dec 14 03:05:45 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:05:47.826196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827de1-bfdd-4767-a273-4979b2faa90b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:47.827274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827de1-bfdd-4767-a273-4979b2faa90b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:47.827274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827de1-bfdd-4767-a273-4979b2faa90b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:47.829053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 643/1294] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:47.834783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:47.835198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:47.835373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:47.853055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:47.854234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:47.870857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 652/1295] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:47 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:05:47.895263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827de1-bfdd-4767-a273-4979b2faa90b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:47.907187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827de1-bfdd-4767-a273-4979b2faa90b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:47.911819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:47.912524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:47.912808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:47.913083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:47.913743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:47.915534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:47.926350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 14 03:05:47.927493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 644/1296] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:05:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:47.933750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:47.942928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731718ba-2840-4b58-a113-ae9f9e8acb79 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:47.947490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:47.948148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:47.948433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:47.948710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:47.949424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:47.949729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:47.951353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:47.956989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 653/1297] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Dec 14 03:05:47 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:47.962907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:47.972106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2d355-5f2c-4ad7-bd42-c385b42f61c2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:47.976503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:47.977105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:47.977382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:47.977649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:47.978424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] RBAC: Adding query filter params (interface=public, service_id=78775dc380274ce5a9baee4c322fa935, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:47.978725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:47.980285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd42f4-83b5-4a30-b555-e93312d9410a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:47.984976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 645/1298] 10.222.0.43 () {56 vars in 1272 bytes} [Tue Dec 14 03:05:47 2021] GET /identity/v3/endpoints?service_id=78775dc380274ce5a9baee4c322fa935&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:05:47.990781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:48.000423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97499ac-12f3-49dc-bcab-b127943ead66 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:48.004872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e856-615f-4751-b2d7-bc445ef2f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:48.005473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e856-615f-4751-b2d7-bc445ef2f266 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:48.005756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e856-615f-4751-b2d7-bc445ef2f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:48.006032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e856-615f-4751-b2d7-bc445ef2f266 admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:48.006701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e856-615f-4751-b2d7-bc445ef2f266 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:48.008261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e856-615f-4751-b2d7-bc445ef2f266 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:48.015540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 654/1299] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:05:47 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:05:50.329180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13cc8f-56de-4b39-8b28-e678372bad66 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:50.329728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13cc8f-56de-4b39-8b28-e678372bad66 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:50.329953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13cc8f-56de-4b39-8b28-e678372bad66 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:50.332576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 646/1300] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:05:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:05:50.340355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:50.340849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:50.340849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:50.360435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:05:50.361621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:05:50.369877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 655/1301] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:05:50 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:05:50.393852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13cc8f-56de-4b39-8b28-e678372bad66 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:50.406180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13cc8f-56de-4b39-8b28-e678372bad66 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:50.410502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:50.411295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:50.411574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:50.411844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:50.412495 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:50.414055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:50.425183 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 14 03:05:50.426270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 647/1302] 10.222.0.43 () {56 vars in 1138 bytes} [Tue Dec 14 03:05:50 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 14 03:05:50.432161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:50.440803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43ab6f-aa4a-4a85-92dd-372d72091620 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:50.445216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:50.445846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:50.446125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:50.446394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] PATH_INFO: `/v3/services` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:50.447130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:05:50.447437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:50.448994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91223d09-4f64-40a5-a522-4bcc0ad17beb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:50.453865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 656/1303] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Dec 14 03:05:50 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:05:50.459388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:05:50.469349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5942817-961a-4c04-bbaa-fffaf32bf501 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:05:50.473757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21156ab-4486-4dcc-9986-c9359ba49b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:05:50.474344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21156ab-4486-4dcc-9986-c9359ba49b6b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:05:50.474620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21156ab-4486-4dcc-9986-c9359ba49b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:05:50.474886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21156ab-4486-4dcc-9986-c9359ba49b6b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:05:50.475644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21156ab-4486-4dcc-9986-c9359ba49b6b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:05:50.477154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21156ab-4486-4dcc-9986-c9359ba49b6b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:05:50.496060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 648/1304] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Dec 14 03:05:50 2021] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:06:52.638064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00f7d-9b0d-4f7b-911f-0e69add91f4f None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:52.639132 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00f7d-9b0d-4f7b-911f-0e69add91f4f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:52.639650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00f7d-9b0d-4f7b-911f-0e69add91f4f None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:52.641658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 657/1305] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:06:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:06:52.647695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72821-8a4e-43fa-8a3e-9f277444dd28 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:52.648528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72821-8a4e-43fa-8a3e-9f277444dd28 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:52.649032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72821-8a4e-43fa-8a3e-9f277444dd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:52.748439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8ad72821-8a4e-43fa-8a3e-9f277444dd28 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:06:52.750042 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8ad72821-8a4e-43fa-8a3e-9f277444dd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:52.907201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 649/1306] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:06:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:06:52.924120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00f7d-9b0d-4f7b-911f-0e69add91f4f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:06:52.926203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-fcb00f7d-9b0d-4f7b-911f-0e69add91f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:53.084840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00f7d-9b0d-4f7b-911f-0e69add91f4f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:06:53.264784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36330-35ad-4394-9a14-af132d8481f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:06:53.265451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36330-35ad-4394-9a14-af132d8481f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:53.265730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36330-35ad-4394-9a14-af132d8481f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:53.265998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36330-35ad-4394-9a14-af132d8481f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:53.266758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36330-35ad-4394-9a14-af132d8481f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:06:53.268696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36330-35ad-4394-9a14-af132d8481f6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:06:53.289109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 658/1307] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:06:52 2021] GET /identity/v3/projects => generated 2553 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:06:55.756850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526fc56-d626-41db-8dbf-466f6a1f3a3c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:55.757651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526fc56-d626-41db-8dbf-466f6a1f3a3c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:55.757934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526fc56-d626-41db-8dbf-466f6a1f3a3c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:55.759747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 650/1308] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:06:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:06:55.766234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80593-327c-440a-8453-4f55032d4e79 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:55.766658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80593-327c-440a-8453-4f55032d4e79 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:55.766787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80593-327c-440a-8453-4f55032d4e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:55.839162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a2d80593-327c-440a-8453-4f55032d4e79 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:06:55.841214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a2d80593-327c-440a-8453-4f55032d4e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:55.943506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 659/1309] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:06:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:06:55.994098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994b42-4b26-4f3c-9270-a3736d4c9101 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:55.994382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994b42-4b26-4f3c-9270-a3736d4c9101 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:55.994654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994b42-4b26-4f3c-9270-a3736d4c9101 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:55.996500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 651/1310] 10.222.0.43 () {54 vars in 964 bytes} [Tue Dec 14 03:06:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:06:56.002594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0d08-b86a-4c67-b6f0-735d7b4cf354 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:56.002873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0d08-b86a-4c67-b6f0-735d7b4cf354 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:56.003172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0d08-b86a-4c67-b6f0-735d7b4cf354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:56.076058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-bb8d0d08-b86a-4c67-b6f0-735d7b4cf354 None None] MFA Rules not processed for user `5f08db48e9814f7db34ffcf7d581fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:06:56.077240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bb8d0d08-b86a-4c67-b6f0-735d7b4cf354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:56.159630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 660/1311] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Dec 14 03:06:56 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:06:56.168787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994b42-4b26-4f3c-9270-a3736d4c9101 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:06:56.170293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2f994b42-4b26-4f3c-9270-a3736d4c9101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:56.272036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994b42-4b26-4f3c-9270-a3736d4c9101 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:06:56.343574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:06:56.344384 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:56.344740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:56.345020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:56.346653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:56.451520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:06:56.452879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3a635-d23b-4063-891f-27f3bbc9b2c4 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:06:56.471188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 652/1312] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:06:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:06:59.089254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28322cd-7a70-489c-862b-9c010971702c None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:59.089837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28322cd-7a70-489c-862b-9c010971702c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:59.089837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28322cd-7a70-489c-862b-9c010971702c None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:59.091659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 661/1313] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:06:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:06:59.097828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbd8a-8f10-4b9f-add0-d23f9055f354 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:59.098251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbd8a-8f10-4b9f-add0-d23f9055f354 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:59.098352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbd8a-8f10-4b9f-add0-d23f9055f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:59.159515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-544cbd8a-8f10-4b9f-add0-d23f9055f354 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:06:59.160693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-544cbd8a-8f10-4b9f-add0-d23f9055f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:59.250202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 653/1314] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:06:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:06:59.290125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28322cd-7a70-489c-862b-9c010971702c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:06:59.291670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f28322cd-7a70-489c-862b-9c010971702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:59.389017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28322cd-7a70-489c-862b-9c010971702c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:06:59.456486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:06:59.457101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:06:59.457376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:06:59.457644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:06:59.459327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:06:59.560987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:06:59.562405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2628-9eb0-41c8-a01f-8e9f9a5cb53e service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:06:59.579720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 662/1315] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:06:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:02.217257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4f8a4-2687-4f41-ad7a-86a0b649dc10 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:02.217808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4f8a4-2687-4f41-ad7a-86a0b649dc10 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:02.217808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4f8a4-2687-4f41-ad7a-86a0b649dc10 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:02.219597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 654/1316] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:02.225187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:02.225631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:02.225725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:02.288673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:02.289868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:02.380971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 663/1317] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:02.416755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4f8a4-2687-4f41-ad7a-86a0b649dc10 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:02.418287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-46f4f8a4-2687-4f41-ad7a-86a0b649dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:02.538573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4f8a4-2687-4f41-ad7a-86a0b649dc10 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:02.625833 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967af9e-e30d-401a-8c3f-47d81d2ce0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:02.626658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967af9e-e30d-401a-8c3f-47d81d2ce0cc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:02.626933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967af9e-e30d-401a-8c3f-47d81d2ce0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:02.627229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967af9e-e30d-401a-8c3f-47d81d2ce0cc admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:02.637089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967af9e-e30d-401a-8c3f-47d81d2ce0cc admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:02.639151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967af9e-e30d-401a-8c3f-47d81d2ce0cc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:02.640797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 655/1318] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:07:02 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:07:02.654389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:02.655623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:02.740205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db67b-4761-4450-a69e-5a05461cbdf3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:02.810315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:02.810946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:02.811255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:02.811528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:02.813129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:02.914946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:02.916388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2a8ad-1bca-48e2-98b6-64445f3a22de service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:02.933655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 664/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:05.788160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd435-c5c2-431b-92b3-dcab3b63032e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:05.788700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd435-c5c2-431b-92b3-dcab3b63032e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:05.788700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd435-c5c2-431b-92b3-dcab3b63032e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:05.790418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 656/1320] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:05.796654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:05.797066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:05.797236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:05.858579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:05.859780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:05.950832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 665/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:05.985955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd435-c5c2-431b-92b3-dcab3b63032e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:05.987738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9e7dd435-c5c2-431b-92b3-dcab3b63032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:06.106036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd435-c5c2-431b-92b3-dcab3b63032e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:06.193508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6397-cc04-42f9-bc56-1aa653149e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:06.194335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6397-cc04-42f9-bc56-1aa653149e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:06.194614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6397-cc04-42f9-bc56-1aa653149e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:06.194885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6397-cc04-42f9-bc56-1aa653149e67 admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:06.204335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c6397-cc04-42f9-bc56-1aa653149e67 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:06.206353 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c6397-cc04-42f9-bc56-1aa653149e67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:06.208061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 657/1322] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:07:05 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:07:06.220520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:06.221717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:06.309488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667cd0f-fd37-4c2a-aef1-77aacd33c9f4 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:06.385260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:06.385821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:06.386612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:06.386883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:06.388546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:06.491480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:06.492920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc497a8-3c67-4f51-9aa1-275891b0c126 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:06.509896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 666/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:09.479421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0813-2ba0-4589-bf16-a657efe44951 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:09.479974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0813-2ba0-4589-bf16-a657efe44951 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:09.480080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0813-2ba0-4589-bf16-a657efe44951 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:09.481839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 658/1324] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:09.488433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d2ff-ead3-4418-b04d-cc151b2e8003 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:09.488837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d2ff-ead3-4418-b04d-cc151b2e8003 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:09.488973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d2ff-ead3-4418-b04d-cc151b2e8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:09.550882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-7419d2ff-ead3-4418-b04d-cc151b2e8003 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:09.552086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7419d2ff-ead3-4418-b04d-cc151b2e8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:09.644955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 667/1325] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:09.684704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0813-2ba0-4589-bf16-a657efe44951 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:09.686286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-946d0813-2ba0-4589-bf16-a657efe44951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:09.785830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0813-2ba0-4589-bf16-a657efe44951 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:09.855878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:09.856516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:09.856799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:09.857075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:09.858697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:09.963510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:09.967121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a25a6a-7a00-4f93-a833-aeca4649e848 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:09.985339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 659/1326] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:12.418459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236d1c-9567-44db-8beb-d2e39d7aa389 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:12.419027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236d1c-9567-44db-8beb-d2e39d7aa389 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:12.419027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236d1c-9567-44db-8beb-d2e39d7aa389 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:12.420796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 668/1327] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:12.426385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490c65-3d0c-43b5-a918-bc1aca142c81 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:12.426820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490c65-3d0c-43b5-a918-bc1aca142c81 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:12.426927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490c65-3d0c-43b5-a918-bc1aca142c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:12.489445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bd490c65-3d0c-43b5-a918-bc1aca142c81 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:12.490624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bd490c65-3d0c-43b5-a918-bc1aca142c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:12.582051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 660/1328] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:12.635599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7fcc-c984-46cf-a8ee-c403445652f5 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:12.636484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7fcc-c984-46cf-a8ee-c403445652f5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:12.636753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7fcc-c984-46cf-a8ee-c403445652f5 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:12.638528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 669/1329] 10.222.0.43 () {54 vars in 964 bytes} [Tue Dec 14 03:07:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:12.644934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb63f-5ba5-4b54-95fc-dbd4d2a11db2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:12.645224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb63f-5ba5-4b54-95fc-dbd4d2a11db2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:12.645498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fb63f-5ba5-4b54-95fc-dbd4d2a11db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:12.722875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c24fb63f-5ba5-4b54-95fc-dbd4d2a11db2 None None] MFA Rules not processed for user `5f08db48e9814f7db34ffcf7d581fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:12.724002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c24fb63f-5ba5-4b54-95fc-dbd4d2a11db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:12.795425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 661/1330] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Dec 14 03:07:12 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:07:12.804574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7fcc-c984-46cf-a8ee-c403445652f5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:12.806052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1f3d7fcc-c984-46cf-a8ee-c403445652f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:12.904585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7fcc-c984-46cf-a8ee-c403445652f5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:12.974965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:12.975543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:12.975820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:12.976087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:12.977683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:13.081499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:13.082926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87792ee-6764-4d24-812e-edd3e394b4a5 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:13.099994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 670/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:15.716682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b50c5-5a78-4c5b-85e2-63bb53ce161a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:15.717224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b50c5-5a78-4c5b-85e2-63bb53ce161a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:15.717224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b50c5-5a78-4c5b-85e2-63bb53ce161a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:15.719009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 662/1332] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:15.724610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:15.725045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:15.725150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:15.787597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:15.788710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:15.882154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 671/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:07:15.914942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b50c5-5a78-4c5b-85e2-63bb53ce161a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:15.916478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ce2b50c5-5a78-4c5b-85e2-63bb53ce161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:16.048454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b50c5-5a78-4c5b-85e2-63bb53ce161a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:16.140800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f076ce5-de44-4ae6-8539-9f90eca0e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:16.141633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076ce5-de44-4ae6-8539-9f90eca0e61c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:16.141910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076ce5-de44-4ae6-8539-9f90eca0e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:16.142181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076ce5-de44-4ae6-8539-9f90eca0e61c admin admin] PATH_INFO: `/v3/projects/d7f09e72d52d44edad5f503d25ed1815` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:16.152278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f076ce5-de44-4ae6-8539-9f90eca0e61c admin admin] RBAC: Authorizing `identity:get_project(project_id=d7f09e72d52d44edad5f503d25ed1815)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:16.154332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f076ce5-de44-4ae6-8539-9f90eca0e61c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:16.156045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 663/1334] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Dec 14 03:07:15 2021] GET /identity/v3/projects/d7f09e72d52d44edad5f503d25ed1815 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:07:16.168884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:16.170070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:16.255524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b600b6-34ce-437b-8ab0-858a2bc9c956 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:16.324344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:16.324976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:16.325252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:16.325521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:16.327146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:16.432852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:16.434319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e060-828d-4da4-b0b7-0866308c5082 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:16.451656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 672/1335] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:19.230464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d9365-a408-4144-833a-27de9fb055e5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:19.231016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d9365-a408-4144-833a-27de9fb055e5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:19.231016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d9365-a408-4144-833a-27de9fb055e5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:19.232814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 664/1336] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:19.238663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18f1d-5e15-4635-b6be-b2ee82a8fb93 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:19.239114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18f1d-5e15-4635-b6be-b2ee82a8fb93 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:19.239209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18f1d-5e15-4635-b6be-b2ee82a8fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:19.300267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-cbf18f1d-5e15-4635-b6be-b2ee82a8fb93 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:19.301464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cbf18f1d-5e15-4635-b6be-b2ee82a8fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:19.392427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 673/1337] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:19.428609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d9365-a408-4144-833a-27de9fb055e5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:19.430094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ea0d9365-a408-4144-833a-27de9fb055e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:19.528528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d9365-a408-4144-833a-27de9fb055e5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:19.599067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:19.599724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:19.600000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:19.600269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:19.601902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:19.709977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:19.711431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56140a-0fda-4eef-9442-3db18e7a1e09 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:19.728355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 665/1338] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:22.105448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a303-34d5-40f7-9c06-3fc44a205a4a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:22.105972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a303-34d5-40f7-9c06-3fc44a205a4a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:22.105972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a303-34d5-40f7-9c06-3fc44a205a4a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:22.107843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 674/1339] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:22.113860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d19c-99da-41b5-aaa5-d096b2b52a30 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:22.114292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d19c-99da-41b5-aaa5-d096b2b52a30 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:22.114403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d19c-99da-41b5-aaa5-d096b2b52a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:22.181699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1429d19c-99da-41b5-aaa5-d096b2b52a30 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:22.182908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1429d19c-99da-41b5-aaa5-d096b2b52a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:22.277609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 666/1340] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:22.318026 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9a303-34d5-40f7-9c06-3fc44a205a4a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:22.319575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-35e9a303-34d5-40f7-9c06-3fc44a205a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:22.419114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9a303-34d5-40f7-9c06-3fc44a205a4a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:22.488439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:22.489083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:22.489363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:22.489633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:22.491298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:22.595317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:22.596759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282f211-7bb7-45c7-9d87-3e704387a862 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:22.614773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 675/1341] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:25.267799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cb42-ffdb-41cb-a513-f967fcb464ab None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:25.268332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cb42-ffdb-41cb-a513-f967fcb464ab None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:25.268332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cb42-ffdb-41cb-a513-f967fcb464ab None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:25.270126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 667/1342] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:25.275959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ef4a-3d2b-4b2f-ac90-7bdc3e4665f4 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:25.276355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ef4a-3d2b-4b2f-ac90-7bdc3e4665f4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:25.276510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ef4a-3d2b-4b2f-ac90-7bdc3e4665f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:25.346102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2b48ef4a-3d2b-4b2f-ac90-7bdc3e4665f4 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:25.347410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2b48ef4a-3d2b-4b2f-ac90-7bdc3e4665f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:25.449370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 676/1343] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:25.487408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5cb42-ffdb-41cb-a513-f967fcb464ab None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:25.489535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-36e5cb42-ffdb-41cb-a513-f967fcb464ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:25.578403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5cb42-ffdb-41cb-a513-f967fcb464ab None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:25.581940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969b5d-22ca-4acd-aae8-5a7c007e0f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:25.582560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969b5d-22ca-4acd-aae8-5a7c007e0f55 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:25.582837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969b5d-22ca-4acd-aae8-5a7c007e0f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:25.583135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969b5d-22ca-4acd-aae8-5a7c007e0f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:25.592038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969b5d-22ca-4acd-aae8-5a7c007e0f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:25.593431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969b5d-22ca-4acd-aae8-5a7c007e0f55 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:25.602220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 668/1344] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:29.904886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafc44-ab18-4b9f-b44f-565411b5796f None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:29.905475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafc44-ab18-4b9f-b44f-565411b5796f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:29.905475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafc44-ab18-4b9f-b44f-565411b5796f None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:29.907217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 677/1345] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:29.912723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444723-eee5-4003-9471-71182901f3cc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:29.913154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444723-eee5-4003-9471-71182901f3cc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:29.913337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444723-eee5-4003-9471-71182901f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:29.930302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ec444723-eee5-4003-9471-71182901f3cc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:29.931525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ec444723-eee5-4003-9471-71182901f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:29.939787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 669/1346] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:29.979368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafc44-ab18-4b9f-b44f-565411b5796f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:29.990031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafc44-ab18-4b9f-b44f-565411b5796f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:29.993551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1b51-b60e-4f7d-b396-c9eb78c59561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:29.994233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1b51-b60e-4f7d-b396-c9eb78c59561 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:29.995158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1b51-b60e-4f7d-b396-c9eb78c59561 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:29.995493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1b51-b60e-4f7d-b396-c9eb78c59561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:30.004155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1b51-b60e-4f7d-b396-c9eb78c59561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:30.005565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1b51-b60e-4f7d-b396-c9eb78c59561 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:30.015506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 678/1347] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:32.936886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc948-5e09-4d39-abc7-c81b8ec130c9 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:32.937414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc948-5e09-4d39-abc7-c81b8ec130c9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:32.937414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc948-5e09-4d39-abc7-c81b8ec130c9 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:32.939335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 670/1348] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:32.945301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3ebc-fbde-418f-a4e3-4e1b7b49fba5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:32.945704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3ebc-fbde-418f-a4e3-4e1b7b49fba5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:32.945853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3ebc-fbde-418f-a4e3-4e1b7b49fba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:32.963796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-005f3ebc-fbde-418f-a4e3-4e1b7b49fba5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:32.964963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-005f3ebc-fbde-418f-a4e3-4e1b7b49fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:32.972796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 679/1349] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:33.011174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc948-5e09-4d39-abc7-c81b8ec130c9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:33.021517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc948-5e09-4d39-abc7-c81b8ec130c9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:33.024972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03eb7-88ad-4f01-a311-49d30bfa6059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:33.026088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03eb7-88ad-4f01-a311-49d30bfa6059 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:33.026370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03eb7-88ad-4f01-a311-49d30bfa6059 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:33.026642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03eb7-88ad-4f01-a311-49d30bfa6059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:33.035445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03eb7-88ad-4f01-a311-49d30bfa6059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:33.036854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03eb7-88ad-4f01-a311-49d30bfa6059 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:33.046458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 671/1350] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:07:37.471965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b7f6-e289-4f44-acd6-95aa1b03e407 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:37.472484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b7f6-e289-4f44-acd6-95aa1b03e407 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:37.472484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b7f6-e289-4f44-acd6-95aa1b03e407 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:37.474240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 680/1351] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:37.480807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19402-4fcc-4e4b-a987-a354169cda07 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:37.481305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19402-4fcc-4e4b-a987-a354169cda07 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:37.481431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19402-4fcc-4e4b-a987-a354169cda07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:37.506375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d9e19402-4fcc-4e4b-a987-a354169cda07 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:37.508133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d9e19402-4fcc-4e4b-a987-a354169cda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:37.521351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 672/1352] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:07:37.561001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527b7f6-e289-4f44-acd6-95aa1b03e407 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:37.571367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527b7f6-e289-4f44-acd6-95aa1b03e407 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:37.574995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691ad44-83af-4c7e-aa38-bdcfd5cce053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:37.575655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691ad44-83af-4c7e-aa38-bdcfd5cce053 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:37.575932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691ad44-83af-4c7e-aa38-bdcfd5cce053 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:37.576203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691ad44-83af-4c7e-aa38-bdcfd5cce053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:37.586897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691ad44-83af-4c7e-aa38-bdcfd5cce053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:37.588922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691ad44-83af-4c7e-aa38-bdcfd5cce053 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:37.598774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 681/1353] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:42.502646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8748a-9e50-4b34-9763-66279531fe2f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:42.506904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8748a-9e50-4b34-9763-66279531fe2f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:42.506904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8748a-9e50-4b34-9763-66279531fe2f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:42.507867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 673/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:07:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:42.515075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0936f8-7522-4255-8b24-e81cf2ab68c2 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:42.515075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0936f8-7522-4255-8b24-e81cf2ab68c2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:42.515576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0936f8-7522-4255-8b24-e81cf2ab68c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:42.611196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ab0936f8-7522-4255-8b24-e81cf2ab68c2 None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:42.613353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ab0936f8-7522-4255-8b24-e81cf2ab68c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:42.715737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 682/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:07:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:47.022892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1bdca-825d-4818-b93f-23905380e7cb None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:47.023457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1bdca-825d-4818-b93f-23905380e7cb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:47.023611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1bdca-825d-4818-b93f-23905380e7cb None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:47.025775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 674/1356] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:07:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:47.031199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d193d49-c627-4b02-8121-b59ab982f5d3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:47.032029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d193d49-c627-4b02-8121-b59ab982f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:47.032452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d193d49-c627-4b02-8121-b59ab982f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:47.051573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6d193d49-c627-4b02-8121-b59ab982f5d3 None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:47.053023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6d193d49-c627-4b02-8121-b59ab982f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:47.062765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 683/1357] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:07:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:48.533058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd183-cd1d-49d4-b566-3fd220007706 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:48.533607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd183-cd1d-49d4-b566-3fd220007706 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:48.533607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd183-cd1d-49d4-b566-3fd220007706 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:48.535444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 675/1358] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:07:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:48.540895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d589f-488a-45f0-8985-a142ad78a39d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:48.541341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d589f-488a-45f0-8985-a142ad78a39d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:48.541488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d589f-488a-45f0-8985-a142ad78a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:48.559206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e14d589f-488a-45f0-8985-a142ad78a39d None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:48.560617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e14d589f-488a-45f0-8985-a142ad78a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:48.569074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 684/1359] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:07:48 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:07:52.350907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd71d-f5c4-4cff-8c4e-6495d825d548 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:52.351575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd71d-f5c4-4cff-8c4e-6495d825d548 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:52.351575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd71d-f5c4-4cff-8c4e-6495d825d548 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:52.353918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 676/1360] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:52.359492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea630f-e274-4586-abc6-de5b78c515e2 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:52.359884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea630f-e274-4586-abc6-de5b78c515e2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:52.360047 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea630f-e274-4586-abc6-de5b78c515e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:52.378641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-36ea630f-e274-4586-abc6-de5b78c515e2 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:52.379849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-36ea630f-e274-4586-abc6-de5b78c515e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:52.387921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 685/1361] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:52.438262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd717b28-f119-4415-89b5-9ffb1ace6097 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:52.438550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd717b28-f119-4415-89b5-9ffb1ace6097 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:52.438835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd717b28-f119-4415-89b5-9ffb1ace6097 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:52.440928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 677/1362] 10.222.0.43 () {54 vars in 961 bytes} [Tue Dec 14 03:07:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:52.446773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0e9d-3b46-4670-a060-d68b82dc4afe None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:52.447104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0e9d-3b46-4670-a060-d68b82dc4afe None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:52.447372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0e9d-3b46-4670-a060-d68b82dc4afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:52.497440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a94a0e9d-3b46-4670-a060-d68b82dc4afe None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:52.498624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a94a0e9d-3b46-4670-a060-d68b82dc4afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:52.580391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 686/1363] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Dec 14 03:07:52 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:52.589188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd717b28-f119-4415-89b5-9ffb1ace6097 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:52.604239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd717b28-f119-4415-89b5-9ffb1ace6097 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:52.610048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520878cb-d5e6-4e01-a574-7d0acc7e97b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:52.610907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520878cb-d5e6-4e01-a574-7d0acc7e97b1 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:52.611469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520878cb-d5e6-4e01-a574-7d0acc7e97b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:52.612284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520878cb-d5e6-4e01-a574-7d0acc7e97b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:52.620825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520878cb-d5e6-4e01-a574-7d0acc7e97b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:52.622748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520878cb-d5e6-4e01-a574-7d0acc7e97b1 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:52.632208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 678/1364] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:55.233218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9592-bb1f-4b8b-8efe-881f7799d003 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:55.233753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9592-bb1f-4b8b-8efe-881f7799d003 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:55.233753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9592-bb1f-4b8b-8efe-881f7799d003 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:55.235646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 687/1365] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:07:55.241450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657f3d-09be-4aca-a534-39d28bd91fc3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:55.241874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657f3d-09be-4aca-a534-39d28bd91fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:55.241993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657f3d-09be-4aca-a534-39d28bd91fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:55.260177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-23657f3d-09be-4aca-a534-39d28bd91fc3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:55.261555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-23657f3d-09be-4aca-a534-39d28bd91fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:55.269436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 679/1366] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:55.314059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b9592-bb1f-4b8b-8efe-881f7799d003 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:55.328545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b9592-bb1f-4b8b-8efe-881f7799d003 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:55.336097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bbf0b-cea1-4d0c-8d48-e38bbc3c7305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:55.336692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bbf0b-cea1-4d0c-8d48-e38bbc3c7305 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:55.337138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bbf0b-cea1-4d0c-8d48-e38bbc3c7305 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:55.338308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bbf0b-cea1-4d0c-8d48-e38bbc3c7305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:55.347390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bbf0b-cea1-4d0c-8d48-e38bbc3c7305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:55.348958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bbf0b-cea1-4d0c-8d48-e38bbc3c7305 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:55.358534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 688/1367] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:07:58.154247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b28a4-49e3-4fa2-88d9-026731b54e44 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:58.154837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b28a4-49e3-4fa2-88d9-026731b54e44 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:58.154837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b28a4-49e3-4fa2-88d9-026731b54e44 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:58.156689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 680/1368] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:07:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:58.162410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63e41-4333-4381-abac-79de75d6b34a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:58.162879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63e41-4333-4381-abac-79de75d6b34a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:58.163084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63e41-4333-4381-abac-79de75d6b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:58.182296 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-52a63e41-4333-4381-abac-79de75d6b34a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:58.183509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-52a63e41-4333-4381-abac-79de75d6b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:58.191467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 689/1369] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:07:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:58.238014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c922f5e-a1af-4c41-8a9d-38bc0105deb6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:58.238542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c922f5e-a1af-4c41-8a9d-38bc0105deb6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:58.238813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c922f5e-a1af-4c41-8a9d-38bc0105deb6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:58.240608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 681/1370] 10.222.0.43 () {54 vars in 961 bytes} [Tue Dec 14 03:07:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:07:58.248614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c086-197b-47c0-858f-4ac3857551e6 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:58.248902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c086-197b-47c0-858f-4ac3857551e6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:58.249173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c086-197b-47c0-858f-4ac3857551e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:58.268023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d1a5c086-197b-47c0-858f-4ac3857551e6 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:07:58.269207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d1a5c086-197b-47c0-858f-4ac3857551e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:07:58.279796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 690/1371] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Dec 14 03:07:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:07:58.289510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c922f5e-a1af-4c41-8a9d-38bc0105deb6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:07:58.310814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c922f5e-a1af-4c41-8a9d-38bc0105deb6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:07:58.316536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538d196-62e3-49d0-8bcd-11ebbbd0894f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:07:58.317178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538d196-62e3-49d0-8bcd-11ebbbd0894f service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:07:58.317458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538d196-62e3-49d0-8bcd-11ebbbd0894f service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:07:58.317731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538d196-62e3-49d0-8bcd-11ebbbd0894f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:07:58.326555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538d196-62e3-49d0-8bcd-11ebbbd0894f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:07:58.328304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538d196-62e3-49d0-8bcd-11ebbbd0894f service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:07:58.340398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 682/1372] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:07:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:00.436787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304532-a5e7-4167-841e-2f302eaa28da None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.437337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304532-a5e7-4167-841e-2f302eaa28da None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.437337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304532-a5e7-4167-841e-2f302eaa28da None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.439119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 691/1373] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:00.445004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4658-b5cd-4e50-90b7-c56ea32886b9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.445425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4658-b5cd-4e50-90b7-c56ea32886b9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.445528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4658-b5cd-4e50-90b7-c56ea32886b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.462958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a70f4658-b5cd-4e50-90b7-c56ea32886b9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:00.464176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a70f4658-b5cd-4e50-90b7-c56ea32886b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:00.471993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 683/1374] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:00.527755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b4ba-2d7a-4c94-8f45-48f53e91227d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.528037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b4ba-2d7a-4c94-8f45-48f53e91227d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.528497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b4ba-2d7a-4c94-8f45-48f53e91227d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.530546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 692/1375] 10.222.0.43 () {54 vars in 963 bytes} [Tue Dec 14 03:08:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:00.536563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a141c8-2a00-438d-bddb-9907dc2765af None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.536979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a141c8-2a00-438d-bddb-9907dc2765af None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.537695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a141c8-2a00-438d-bddb-9907dc2765af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.591968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c4a141c8-2a00-438d-bddb-9907dc2765af None None] MFA Rules not processed for user `647e47606fc9438cb580f58fe7daae4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:00.593323 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c4a141c8-2a00-438d-bddb-9907dc2765af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:00.652292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 684/1376] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Dec 14 03:08:00 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:00.663468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b4ba-2d7a-4c94-8f45-48f53e91227d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:00.679463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b4ba-2d7a-4c94-8f45-48f53e91227d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:00.683534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b895dc8-aa86-4f2e-8912-e178ee46d46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:00.684636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895dc8-aa86-4f2e-8912-e178ee46d46f service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.685223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895dc8-aa86-4f2e-8912-e178ee46d46f service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.685742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895dc8-aa86-4f2e-8912-e178ee46d46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.696310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b895dc8-aa86-4f2e-8912-e178ee46d46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:00.697973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b895dc8-aa86-4f2e-8912-e178ee46d46f service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:00.709147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 693/1377] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:00.761342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1cef8-3610-41c4-9741-2d27a7ed9765 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.761632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1cef8-3610-41c4-9741-2d27a7ed9765 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.761910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1cef8-3610-41c4-9741-2d27a7ed9765 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.763714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 685/1378] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:00.769462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcd45-dd59-44c1-9bdd-17b354cbf990 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.769858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcd45-dd59-44c1-9bdd-17b354cbf990 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.770238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcd45-dd59-44c1-9bdd-17b354cbf990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.787831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f24bcd45-dd59-44c1-9bdd-17b354cbf990 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:00.789136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f24bcd45-dd59-44c1-9bdd-17b354cbf990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:00.799234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 694/1379] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:00.843000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1cef8-3610-41c4-9741-2d27a7ed9765 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:00.858052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1cef8-3610-41c4-9741-2d27a7ed9765 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:00.863823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769e0a-b235-40e2-afb1-4ee3a5d67aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:00.864450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769e0a-b235-40e2-afb1-4ee3a5d67aa0 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:00.864732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769e0a-b235-40e2-afb1-4ee3a5d67aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:00.865008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769e0a-b235-40e2-afb1-4ee3a5d67aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:00.873681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b769e0a-b235-40e2-afb1-4ee3a5d67aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:00.875277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b769e0a-b235-40e2-afb1-4ee3a5d67aa0 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:00.886926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 686/1380] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:03.273943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf60b-c2ed-4673-8bdf-0688124d558f None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:03.274448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf60b-c2ed-4673-8bdf-0688124d558f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:03.274448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf60b-c2ed-4673-8bdf-0688124d558f None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:03.276282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 695/1381] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:03.282248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1dcc1-21f7-48d6-90a0-131fa559ee11 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:03.282663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1dcc1-21f7-48d6-90a0-131fa559ee11 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:03.282807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1dcc1-21f7-48d6-90a0-131fa559ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:03.300674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-42b1dcc1-21f7-48d6-90a0-131fa559ee11 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:03.301838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-42b1dcc1-21f7-48d6-90a0-131fa559ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:03.310250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 687/1382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:03.355205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf60b-c2ed-4673-8bdf-0688124d558f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:03.370276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf60b-c2ed-4673-8bdf-0688124d558f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:03.375943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2999-cc1a-45c0-9498-2f2756fb552a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:03.376590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2999-cc1a-45c0-9498-2f2756fb552a service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:03.376872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2999-cc1a-45c0-9498-2f2756fb552a service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:03.377143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2999-cc1a-45c0-9498-2f2756fb552a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:03.385167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2999-cc1a-45c0-9498-2f2756fb552a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:03.386733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2999-cc1a-45c0-9498-2f2756fb552a service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:03.395793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 696/1383] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:05.788000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d4da-82b7-4879-8379-de25deffc42a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:05.788496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d4da-82b7-4879-8379-de25deffc42a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:05.788496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d4da-82b7-4879-8379-de25deffc42a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:05.790876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 688/1384] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:05.796776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661aced-66e1-47a1-86c9-fc6b9ff5df60 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:05.797199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661aced-66e1-47a1-86c9-fc6b9ff5df60 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:05.797337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661aced-66e1-47a1-86c9-fc6b9ff5df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:05.815593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0661aced-66e1-47a1-86c9-fc6b9ff5df60 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:05.816788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0661aced-66e1-47a1-86c9-fc6b9ff5df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:05.824600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 697/1385] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:05.871972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d4da-82b7-4879-8379-de25deffc42a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:05.886452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d4da-82b7-4879-8379-de25deffc42a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:05.892465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb7dd7-3136-4b31-af82-f1bd426471ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:05.893097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7dd7-3136-4b31-af82-f1bd426471ef service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:05.893376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7dd7-3136-4b31-af82-f1bd426471ef service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:05.893648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7dd7-3136-4b31-af82-f1bd426471ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:05.903694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb7dd7-3136-4b31-af82-f1bd426471ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:05.905251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb7dd7-3136-4b31-af82-f1bd426471ef service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:05.916705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 689/1386] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:08.330134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98c28-ac0d-494c-83bf-8ee360359066 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:08.330693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98c28-ac0d-494c-83bf-8ee360359066 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:08.330781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98c28-ac0d-494c-83bf-8ee360359066 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:08.332642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 698/1387] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:08.341735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26c39-8b3a-4b00-a9fb-59ea769faf9e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:08.342221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26c39-8b3a-4b00-a9fb-59ea769faf9e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:08.342624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26c39-8b3a-4b00-a9fb-59ea769faf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:08.364962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d1d26c39-8b3a-4b00-a9fb-59ea769faf9e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:08.366142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d1d26c39-8b3a-4b00-a9fb-59ea769faf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:08.374190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 690/1388] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:08.420925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf98c28-ac0d-494c-83bf-8ee360359066 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:08.435085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf98c28-ac0d-494c-83bf-8ee360359066 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:08.440676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af08959-1d6d-46f9-9bdb-f0235450af25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:08.441298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af08959-1d6d-46f9-9bdb-f0235450af25 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:08.441584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af08959-1d6d-46f9-9bdb-f0235450af25 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:08.441864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af08959-1d6d-46f9-9bdb-f0235450af25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:08.450211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af08959-1d6d-46f9-9bdb-f0235450af25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:08.451846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af08959-1d6d-46f9-9bdb-f0235450af25 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:08.461245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 699/1389] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:11.879469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f29437-e99f-4b4e-8135-a419432aaa91 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:11.879997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f29437-e99f-4b4e-8135-a419432aaa91 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:11.880076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f29437-e99f-4b4e-8135-a419432aaa91 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:11.881857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 691/1390] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:11.887919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d38c-2313-4bc1-af99-99ecbe06eb25 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:11.888335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d38c-2313-4bc1-af99-99ecbe06eb25 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:11.888543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d38c-2313-4bc1-af99-99ecbe06eb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:11.907017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ca61d38c-2313-4bc1-af99-99ecbe06eb25 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:11.908219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ca61d38c-2313-4bc1-af99-99ecbe06eb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:11.916633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 700/1391] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:08:11.962618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f29437-e99f-4b4e-8135-a419432aaa91 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:11.976950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f29437-e99f-4b4e-8135-a419432aaa91 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:11.983772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5384db-9122-4442-81ab-268aa558226d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:11.984375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5384db-9122-4442-81ab-268aa558226d service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:11.984656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5384db-9122-4442-81ab-268aa558226d service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:11.984933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5384db-9122-4442-81ab-268aa558226d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:11.993874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5384db-9122-4442-81ab-268aa558226d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:11.995482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5384db-9122-4442-81ab-268aa558226d service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:12.005171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 692/1392] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:14.389927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958d021-0659-421f-86dd-9f37c943ae67 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:14.390477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958d021-0659-421f-86dd-9f37c943ae67 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:14.390477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958d021-0659-421f-86dd-9f37c943ae67 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:14.392450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 701/1393] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:14.398025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1df74-ecc7-4c85-8980-4a4fba77224d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:14.398453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1df74-ecc7-4c85-8980-4a4fba77224d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:14.398596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1df74-ecc7-4c85-8980-4a4fba77224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:14.416309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0ae1df74-ecc7-4c85-8980-4a4fba77224d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:14.417499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0ae1df74-ecc7-4c85-8980-4a4fba77224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:14.425239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 693/1394] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:14.470856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958d021-0659-421f-86dd-9f37c943ae67 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:14.485455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958d021-0659-421f-86dd-9f37c943ae67 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:14.490959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a1f6-e0e1-48e5-84ac-5bc71fe89fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:14.491602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a1f6-e0e1-48e5-84ac-5bc71fe89fe4 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:14.491879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a1f6-e0e1-48e5-84ac-5bc71fe89fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:14.492151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a1f6-e0e1-48e5-84ac-5bc71fe89fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:14.500553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a1f6-e0e1-48e5-84ac-5bc71fe89fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:14.502110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a1f6-e0e1-48e5-84ac-5bc71fe89fe4 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:14.511920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 702/1395] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:15.740772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4a8d-e6b2-4080-9724-7bea085ede49 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:15.741314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4a8d-e6b2-4080-9724-7bea085ede49 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:15.741314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4a8d-e6b2-4080-9724-7bea085ede49 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:15.743169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 694/1396] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:15.748749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4634716-7577-44bf-bf3d-d9db208a378d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:15.749160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4634716-7577-44bf-bf3d-d9db208a378d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:15.749311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4634716-7577-44bf-bf3d-d9db208a378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:15.767034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f4634716-7577-44bf-bf3d-d9db208a378d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:15.768241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f4634716-7577-44bf-bf3d-d9db208a378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:15.776325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 703/1397] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:15.833090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b947f-b75b-4c85-abf7-377469e14e27 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:15.833460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b947f-b75b-4c85-abf7-377469e14e27 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:15.833796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b947f-b75b-4c85-abf7-377469e14e27 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:15.835655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 695/1398] 10.222.0.43 () {54 vars in 962 bytes} [Tue Dec 14 03:08:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:15.841902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4802-b311-438b-bbf6-5b1670511c03 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:15.842224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4802-b311-438b-bbf6-5b1670511c03 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:15.842504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4802-b311-438b-bbf6-5b1670511c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:15.889447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ac0a4802-b311-438b-bbf6-5b1670511c03 None None] MFA Rules not processed for user `1a9f0d0a342649658a174da2d495fe8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:15.890650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ac0a4802-b311-438b-bbf6-5b1670511c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:15.946850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 704/1399] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Dec 14 03:08:15 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:15.954983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b947f-b75b-4c85-abf7-377469e14e27 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:15.965920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b947f-b75b-4c85-abf7-377469e14e27 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:15.969719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b6faf-3fad-48b3-9bd8-2514d9b50a37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:15.970513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6faf-3fad-48b3-9bd8-2514d9b50a37 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:15.970961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6faf-3fad-48b3-9bd8-2514d9b50a37 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:15.971426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6faf-3fad-48b3-9bd8-2514d9b50a37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:15.980964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6faf-3fad-48b3-9bd8-2514d9b50a37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:15.982541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6faf-3fad-48b3-9bd8-2514d9b50a37 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:15.992417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 696/1400] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:16.421544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9a849-546d-4d6f-8c65-a9352535cbdd None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:16.421993 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9a849-546d-4d6f-8c65-a9352535cbdd None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:16.422369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9a849-546d-4d6f-8c65-a9352535cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:16.471652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1ff9a849-546d-4d6f-8c65-a9352535cbdd None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:16.472894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1ff9a849-546d-4d6f-8c65-a9352535cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:16.537318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 705/1401] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:08:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:16.579786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a732e5-85e4-4d9b-b604-36b5129ef011 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:16.580074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a732e5-85e4-4d9b-b604-36b5129ef011 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:16.580343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a732e5-85e4-4d9b-b604-36b5129ef011 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:16.582279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 697/1402] 10.222.0.43 () {54 vars in 942 bytes} [Tue Dec 14 03:08:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:16.589520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc198ff-c1da-4411-a87d-5b70be6e654a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:16.590065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc198ff-c1da-4411-a87d-5b70be6e654a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:16.590281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc198ff-c1da-4411-a87d-5b70be6e654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:16.638995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1cc198ff-c1da-4411-a87d-5b70be6e654a None None] MFA Rules not processed for user `8abbf99271a142d0b6b33194845916aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:16.640499 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1cc198ff-c1da-4411-a87d-5b70be6e654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:16.723737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 706/1403] 10.222.0.43 () {58 vars in 1039 bytes} [Tue Dec 14 03:08:16 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:16.734118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a732e5-85e4-4d9b-b604-36b5129ef011 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:16.747450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a732e5-85e4-4d9b-b604-36b5129ef011 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:16.752719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f7b4b-7038-44ed-80c7-d2c22460e2f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:16.753426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7b4b-7038-44ed-80c7-d2c22460e2f8 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:16.753775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7b4b-7038-44ed-80c7-d2c22460e2f8 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:16.754133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7b4b-7038-44ed-80c7-d2c22460e2f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:16.763228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f7b4b-7038-44ed-80c7-d2c22460e2f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:16.764871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f7b4b-7038-44ed-80c7-d2c22460e2f8 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:16.772992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 698/1404] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:08:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:08:16.889426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3012ad-96fa-4dbc-a25b-13844186535b None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:16.889862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3012ad-96fa-4dbc-a25b-13844186535b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:16.890015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3012ad-96fa-4dbc-a25b-13844186535b None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:16.891865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 707/1405] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:16.897610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22ab37-d2b0-44e4-bab8-562d0ce768fd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:16.897899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22ab37-d2b0-44e4-bab8-562d0ce768fd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:16.898177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22ab37-d2b0-44e4-bab8-562d0ce768fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:16.932468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ce22ab37-d2b0-44e4-bab8-562d0ce768fd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:16.933658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ce22ab37-d2b0-44e4-bab8-562d0ce768fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:16.941423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 699/1406] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:16.987608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3012ad-96fa-4dbc-a25b-13844186535b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:17.003082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3012ad-96fa-4dbc-a25b-13844186535b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:17.009286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ea835-3e61-4096-96ef-5ca6e5ab78eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:17.009904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea835-3e61-4096-96ef-5ca6e5ab78eb service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:17.010182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea835-3e61-4096-96ef-5ca6e5ab78eb service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:17.010453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea835-3e61-4096-96ef-5ca6e5ab78eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:17.025261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ea835-3e61-4096-96ef-5ca6e5ab78eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:17.026902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ea835-3e61-4096-96ef-5ca6e5ab78eb service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:17.036897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 708/1407] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:19.415879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296abaee-df3d-4ea3-9bc8-815e18ba15b7 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:19.416956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296abaee-df3d-4ea3-9bc8-815e18ba15b7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:19.417308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296abaee-df3d-4ea3-9bc8-815e18ba15b7 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:19.419177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 700/1408] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:19.424726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336961d7-5aee-4624-8313-075391d8d75c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:19.425241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336961d7-5aee-4624-8313-075391d8d75c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:19.425330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336961d7-5aee-4624-8313-075391d8d75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:19.444120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-336961d7-5aee-4624-8313-075391d8d75c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:19.445334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-336961d7-5aee-4624-8313-075391d8d75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:19.453713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 709/1409] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:19.502188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296abaee-df3d-4ea3-9bc8-815e18ba15b7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:19.516514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296abaee-df3d-4ea3-9bc8-815e18ba15b7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:19.522288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0d0e7-4ea1-4bfa-b1b2-d15c51b1e051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:19.525399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0d0e7-4ea1-4bfa-b1b2-d15c51b1e051 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:19.525399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0d0e7-4ea1-4bfa-b1b2-d15c51b1e051 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:19.525399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0d0e7-4ea1-4bfa-b1b2-d15c51b1e051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:19.533498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0d0e7-4ea1-4bfa-b1b2-d15c51b1e051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:19.534475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0d0e7-4ea1-4bfa-b1b2-d15c51b1e051 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:19.544523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 701/1410] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:21.948481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b70a-afa7-4ca6-9c21-e8c85af70816 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:21.949036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b70a-afa7-4ca6-9c21-e8c85af70816 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:21.949036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b70a-afa7-4ca6-9c21-e8c85af70816 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:21.950837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 710/1411] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:08:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:21.956458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e11b-f4ed-4a4f-a72d-b5a3ca0b29fb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:21.956908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e11b-f4ed-4a4f-a72d-b5a3ca0b29fb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:21.957024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e11b-f4ed-4a4f-a72d-b5a3ca0b29fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:21.976011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c0a8e11b-f4ed-4a4f-a72d-b5a3ca0b29fb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:21.977784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c0a8e11b-f4ed-4a4f-a72d-b5a3ca0b29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:21.987161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 702/1412] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:08:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:22.033037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b70a-afa7-4ca6-9c21-e8c85af70816 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:22.048735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b70a-afa7-4ca6-9c21-e8c85af70816 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:22.053470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95fecf-e7fd-4a03-bc3e-31123e6ab2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:22.054369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95fecf-e7fd-4a03-bc3e-31123e6ab2eb service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:22.054897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95fecf-e7fd-4a03-bc3e-31123e6ab2eb service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:22.055281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95fecf-e7fd-4a03-bc3e-31123e6ab2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:22.064098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95fecf-e7fd-4a03-bc3e-31123e6ab2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:22.065700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95fecf-e7fd-4a03-bc3e-31123e6ab2eb service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:22.080498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 711/1413] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:39.552806 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f7cd-05a9-4387-a35c-d3e65a4ab5c5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:39.553252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f7cd-05a9-4387-a35c-d3e65a4ab5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:39.553443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f7cd-05a9-4387-a35c-d3e65a4ab5c5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:39.556129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 703/1414] 10.222.0.43 () {54 vars in 918 bytes} [Tue Dec 14 03:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:39.561118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb751-ffac-453f-a2a8-1cbc4eacf899 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:39.561547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb751-ffac-453f-a2a8-1cbc4eacf899 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:39.561666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb751-ffac-453f-a2a8-1cbc4eacf899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:39.579617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-76ceb751-ffac-453f-a2a8-1cbc4eacf899 None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:39.580785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-76ceb751-ffac-453f-a2a8-1cbc4eacf899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:39.589627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 712/1415] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Dec 14 03:08:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:39.604351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed5121-b5af-47d5-83f9-603c4fff3552 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:39.604635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed5121-b5af-47d5-83f9-603c4fff3552 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:39.604904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed5121-b5af-47d5-83f9-603c4fff3552 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:39.606628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 704/1416] 10.222.0.43 () {54 vars in 918 bytes} [Tue Dec 14 03:08:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:39.612159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bd407-495e-4afd-a303-e10db68d7812 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:39.612448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bd407-495e-4afd-a303-e10db68d7812 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:39.612728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bd407-495e-4afd-a303-e10db68d7812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:39.630401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-3b2bd407-495e-4afd-a303-e10db68d7812 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:39.631591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3b2bd407-495e-4afd-a303-e10db68d7812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:39.641044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 713/1417] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Dec 14 03:08:39 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:42.359066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafa215-91ba-4816-973b-9471695665a3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:42.359605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafa215-91ba-4816-973b-9471695665a3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:42.359605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafa215-91ba-4816-973b-9471695665a3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:42.361366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 705/1418] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:08:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:42.368078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf404d46-2bfe-4b60-967b-bfb1e5217e55 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:42.368462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf404d46-2bfe-4b60-967b-bfb1e5217e55 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:42.368636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf404d46-2bfe-4b60-967b-bfb1e5217e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:42.385934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-cf404d46-2bfe-4b60-967b-bfb1e5217e55 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:42.387144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cf404d46-2bfe-4b60-967b-bfb1e5217e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:42.394721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 714/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:08:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:42.438131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafa215-91ba-4816-973b-9471695665a3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:42.451707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafa215-91ba-4816-973b-9471695665a3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:42.456913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b975e-b91f-4965-abc6-ea12cf3f488f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:42.457519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b975e-b91f-4965-abc6-ea12cf3f488f service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:42.457796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b975e-b91f-4965-abc6-ea12cf3f488f service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:42.458061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b975e-b91f-4965-abc6-ea12cf3f488f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:42.465734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b975e-b91f-4965-abc6-ea12cf3f488f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:42.467297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b975e-b91f-4965-abc6-ea12cf3f488f service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:42.476125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 706/1420] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:44.098999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6f3f-cec2-403c-9688-8ddd291c254c None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:44.099726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6f3f-cec2-403c-9688-8ddd291c254c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:44.100006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6f3f-cec2-403c-9688-8ddd291c254c None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:44.102434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 715/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:44.108006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b509-b9ed-4389-bb54-8b047450722a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:44.108401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b509-b9ed-4389-bb54-8b047450722a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:44.108592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b509-b9ed-4389-bb54-8b047450722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:44.126460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8215b509-b9ed-4389-bb54-8b047450722a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:44.127667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8215b509-b9ed-4389-bb54-8b047450722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:44.135430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 707/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:44.287749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6f3f-cec2-403c-9688-8ddd291c254c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:44.301727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6f3f-cec2-403c-9688-8ddd291c254c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:44.307560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054894c-472c-441d-9734-d1d918337963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:44.308172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054894c-472c-441d-9734-d1d918337963 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:44.308454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054894c-472c-441d-9734-d1d918337963 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:44.308725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054894c-472c-441d-9734-d1d918337963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:44.316513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054894c-472c-441d-9734-d1d918337963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:44.318083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054894c-472c-441d-9734-d1d918337963 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:44.327678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 716/1423] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:45.872767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcecb6d-a21e-48f2-824d-d65df131c6b2 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:45.873321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcecb6d-a21e-48f2-824d-d65df131c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:45.873321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcecb6d-a21e-48f2-824d-d65df131c6b2 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:45.875185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 708/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:45.880634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478487f0-3ab4-416c-9b6a-be36b97d5c64 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:45.881057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478487f0-3ab4-416c-9b6a-be36b97d5c64 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:45.881189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478487f0-3ab4-416c-9b6a-be36b97d5c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:45.899278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-478487f0-3ab4-416c-9b6a-be36b97d5c64 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:45.900462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-478487f0-3ab4-416c-9b6a-be36b97d5c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:45.908134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 717/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:46.060107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcecb6d-a21e-48f2-824d-d65df131c6b2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:46.073981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcecb6d-a21e-48f2-824d-d65df131c6b2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:46.079414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde371a-0c60-4499-9097-a8cc6d45bca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:46.080035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde371a-0c60-4499-9097-a8cc6d45bca7 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:46.080321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde371a-0c60-4499-9097-a8cc6d45bca7 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:46.080594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde371a-0c60-4499-9097-a8cc6d45bca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:46.088449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde371a-0c60-4499-9097-a8cc6d45bca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:46.090016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde371a-0c60-4499-9097-a8cc6d45bca7 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:46.099087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 709/1426] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:47.608112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cdcbd-442f-4eae-9758-149a5a5f3672 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:47.608595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cdcbd-442f-4eae-9758-149a5a5f3672 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:47.608701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cdcbd-442f-4eae-9758-149a5a5f3672 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:47.610452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 718/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:47.616715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606912a9-a34d-4ab3-9106-8a161bac097e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:47.617156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606912a9-a34d-4ab3-9106-8a161bac097e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:47.617273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606912a9-a34d-4ab3-9106-8a161bac097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:47.635804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-606912a9-a34d-4ab3-9106-8a161bac097e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:47.636987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-606912a9-a34d-4ab3-9106-8a161bac097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:47.644690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 710/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:47.796067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cdcbd-442f-4eae-9758-149a5a5f3672 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:47.810432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cdcbd-442f-4eae-9758-149a5a5f3672 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:47.815713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50399029-5df8-4713-9412-db669efa27ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:47.816323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50399029-5df8-4713-9412-db669efa27ba service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:47.816597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50399029-5df8-4713-9412-db669efa27ba service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:47.816862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50399029-5df8-4713-9412-db669efa27ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:47.824647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50399029-5df8-4713-9412-db669efa27ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:47.826204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50399029-5df8-4713-9412-db669efa27ba service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:47.835202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 719/1429] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:49.349622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa655b-2dbb-4de7-83d3-4a173cf6b8f6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:49.350197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa655b-2dbb-4de7-83d3-4a173cf6b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:49.350197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa655b-2dbb-4de7-83d3-4a173cf6b8f6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:49.351991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 711/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:49.357463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a8a9-27e4-4827-b5fa-078e050906f8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:49.357842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a8a9-27e4-4827-b5fa-078e050906f8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:49.358018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a8a9-27e4-4827-b5fa-078e050906f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:49.376331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5840a8a9-27e4-4827-b5fa-078e050906f8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:49.377519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5840a8a9-27e4-4827-b5fa-078e050906f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:49.385750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 720/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:49.536860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa655b-2dbb-4de7-83d3-4a173cf6b8f6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:49.551002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa655b-2dbb-4de7-83d3-4a173cf6b8f6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:49.557188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f43d7-865b-4f22-a5ca-e1b4e60b6dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:49.557814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f43d7-865b-4f22-a5ca-e1b4e60b6dae service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:49.558095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f43d7-865b-4f22-a5ca-e1b4e60b6dae service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:49.558371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f43d7-865b-4f22-a5ca-e1b4e60b6dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:49.566386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f43d7-865b-4f22-a5ca-e1b4e60b6dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:49.567989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f43d7-865b-4f22-a5ca-e1b4e60b6dae service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:49.577648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 712/1432] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:51.029834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20065d-c142-4028-93c7-3b25cba46529 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:51.030342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20065d-c142-4028-93c7-3b25cba46529 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:51.030342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20065d-c142-4028-93c7-3b25cba46529 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:51.032091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 721/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:51.037455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3198-80d0-47d0-9522-cafb583d6256 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:51.037871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3198-80d0-47d0-9522-cafb583d6256 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:51.038037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3198-80d0-47d0-9522-cafb583d6256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:51.056692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bb4c3198-80d0-47d0-9522-cafb583d6256 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:51.058345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb4c3198-80d0-47d0-9522-cafb583d6256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:51.065971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 713/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:51.216622 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20065d-c142-4028-93c7-3b25cba46529 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:51.230893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20065d-c142-4028-93c7-3b25cba46529 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:51.236466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aefc9-47ac-493b-b224-c7c4bbed2d9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:51.237344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aefc9-47ac-493b-b224-c7c4bbed2d9c service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:51.237624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aefc9-47ac-493b-b224-c7c4bbed2d9c service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:51.237898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aefc9-47ac-493b-b224-c7c4bbed2d9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:51.246295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aefc9-47ac-493b-b224-c7c4bbed2d9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:51.247934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aefc9-47ac-493b-b224-c7c4bbed2d9c service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:51.257073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 722/1435] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:52.711589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbed76-50d8-445d-a15c-e9f3f7edb464 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:52.712096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbed76-50d8-445d-a15c-e9f3f7edb464 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:52.712211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbed76-50d8-445d-a15c-e9f3f7edb464 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:52.713942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 714/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:52.719475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e18e-a8dd-4274-9241-b00bb7a37204 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:52.719894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e18e-a8dd-4274-9241-b00bb7a37204 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:52.720031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e18e-a8dd-4274-9241-b00bb7a37204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:52.738744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d874e18e-a8dd-4274-9241-b00bb7a37204 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:52.739969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d874e18e-a8dd-4274-9241-b00bb7a37204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:52.747715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 723/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:52.901615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbed76-50d8-445d-a15c-e9f3f7edb464 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:52.916221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbed76-50d8-445d-a15c-e9f3f7edb464 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:52.921466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13950e83-77d7-4282-9100-f06e5664f2ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:52.922081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13950e83-77d7-4282-9100-f06e5664f2ed service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:52.922364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13950e83-77d7-4282-9100-f06e5664f2ed service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:52.922640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13950e83-77d7-4282-9100-f06e5664f2ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:52.931152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13950e83-77d7-4282-9100-f06e5664f2ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:52.932705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13950e83-77d7-4282-9100-f06e5664f2ed service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:52.941715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 715/1438] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:54.412603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12e775-9111-46cb-a5ca-f6c48e3beaa7 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:54.413222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12e775-9111-46cb-a5ca-f6c48e3beaa7 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:54.413222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12e775-9111-46cb-a5ca-f6c48e3beaa7 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:54.414952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 724/1439] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:54.420339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5cce-630a-43e7-b3a6-d70b7bd80958 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:54.420795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5cce-630a-43e7-b3a6-d70b7bd80958 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:54.420925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5cce-630a-43e7-b3a6-d70b7bd80958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:54.438535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-850b5cce-630a-43e7-b3a6-d70b7bd80958 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:54.439779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-850b5cce-630a-43e7-b3a6-d70b7bd80958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:54.448589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 716/1440] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:54.601409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12e775-9111-46cb-a5ca-f6c48e3beaa7 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:54.615584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12e775-9111-46cb-a5ca-f6c48e3beaa7 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:54.621489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889652-8c62-422a-80dc-c6c9119c1aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:54.622106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889652-8c62-422a-80dc-c6c9119c1aed service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:54.622388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889652-8c62-422a-80dc-c6c9119c1aed service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:54.622665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889652-8c62-422a-80dc-c6c9119c1aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:54.630500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889652-8c62-422a-80dc-c6c9119c1aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:54.632113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889652-8c62-422a-80dc-c6c9119c1aed service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:54.641768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 725/1441] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:56.108173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8932-04e4-4a9f-b723-afa2adc34338 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:56.108723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8932-04e4-4a9f-b723-afa2adc34338 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:56.108723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8932-04e4-4a9f-b723-afa2adc34338 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:56.110499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 717/1442] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:08:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:56.116298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243d07-3339-4a83-bbe0-a2e3d00c0c16 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:56.116718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243d07-3339-4a83-bbe0-a2e3d00c0c16 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:56.116849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243d07-3339-4a83-bbe0-a2e3d00c0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:56.134885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4f243d07-3339-4a83-bbe0-a2e3d00c0c16 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:56.136098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4f243d07-3339-4a83-bbe0-a2e3d00c0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:56.143782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 726/1443] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:08:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:56.294306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea8932-04e4-4a9f-b723-afa2adc34338 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:56.308121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea8932-04e4-4a9f-b723-afa2adc34338 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:56.313410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f2d2f-d566-494c-ac82-1103d4a2e2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:56.314027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f2d2f-d566-494c-ac82-1103d4a2e2a5 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:56.314309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f2d2f-d566-494c-ac82-1103d4a2e2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:56.314581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f2d2f-d566-494c-ac82-1103d4a2e2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:56.322389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f2d2f-d566-494c-ac82-1103d4a2e2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:56.323969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f2d2f-d566-494c-ac82-1103d4a2e2a5 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:56.333420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 718/1444] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:58.568074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb882b-e488-442b-9455-63a08224fcf5 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:58.568641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb882b-e488-442b-9455-63a08224fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:58.568641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb882b-e488-442b-9455-63a08224fcf5 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:58.570423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 727/1445] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:08:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:08:58.576371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d665b5-3adc-4775-b460-b3cc42c23d8b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:58.576809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d665b5-3adc-4775-b460-b3cc42c23d8b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:58.576918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d665b5-3adc-4775-b460-b3cc42c23d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:58.594754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e1d665b5-3adc-4775-b460-b3cc42c23d8b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:08:58.595977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e1d665b5-3adc-4775-b460-b3cc42c23d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:08:58.604288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 719/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:08:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:08:58.643203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb882b-e488-442b-9455-63a08224fcf5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:08:58.654349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb882b-e488-442b-9455-63a08224fcf5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:08:58.657917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46f3fb-c686-4db7-a065-4669359cc2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:08:58.658543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46f3fb-c686-4db7-a065-4669359cc2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:08:58.658825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46f3fb-c686-4db7-a065-4669359cc2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:08:58.659128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46f3fb-c686-4db7-a065-4669359cc2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:08:58.668597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46f3fb-c686-4db7-a065-4669359cc2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:08:58.670034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46f3fb-c686-4db7-a065-4669359cc2d8 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:08:58.679210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 728/1447] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:08:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:01.155006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f654b-d0b2-4b9c-bc3e-05e643cce7e5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:01.155702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f654b-d0b2-4b9c-bc3e-05e643cce7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:01.155702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f654b-d0b2-4b9c-bc3e-05e643cce7e5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:01.157371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 720/1448] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:01.163207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84fc8-99c8-4aa1-8221-a7ad6ecf9e93 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:01.164189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84fc8-99c8-4aa1-8221-a7ad6ecf9e93 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:01.164304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84fc8-99c8-4aa1-8221-a7ad6ecf9e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:01.181896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-65b84fc8-99c8-4aa1-8221-a7ad6ecf9e93 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:01.183088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-65b84fc8-99c8-4aa1-8221-a7ad6ecf9e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:01.190528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 729/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:01.229811 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f654b-d0b2-4b9c-bc3e-05e643cce7e5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:01.240324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f654b-d0b2-4b9c-bc3e-05e643cce7e5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:01.244476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf34bbb-6db9-4e00-87a9-4e67e81c8c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:01.245109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34bbb-6db9-4e00-87a9-4e67e81c8c4a service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:01.245395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34bbb-6db9-4e00-87a9-4e67e81c8c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:01.245673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34bbb-6db9-4e00-87a9-4e67e81c8c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:01.254521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf34bbb-6db9-4e00-87a9-4e67e81c8c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:01.255975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf34bbb-6db9-4e00-87a9-4e67e81c8c4a service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:01.265093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 721/1450] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:03.894934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054e64-b502-4250-a41c-2e37807cc23d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:03.895466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054e64-b502-4250-a41c-2e37807cc23d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:03.895466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054e64-b502-4250-a41c-2e37807cc23d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:03.897457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 730/1451] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:03.904245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834bfc2-2c3b-4739-9e6e-d027a56d7f3e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:03.904654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834bfc2-2c3b-4739-9e6e-d027a56d7f3e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:03.904791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834bfc2-2c3b-4739-9e6e-d027a56d7f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:03.922558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e834bfc2-2c3b-4739-9e6e-d027a56d7f3e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:03.923788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e834bfc2-2c3b-4739-9e6e-d027a56d7f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:03.931509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 722/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:03.970998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054e64-b502-4250-a41c-2e37807cc23d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:03.981934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054e64-b502-4250-a41c-2e37807cc23d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:03.985326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c5eac-05a4-44e1-a3a9-18571836189b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:03.985933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5eac-05a4-44e1-a3a9-18571836189b service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:03.986214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5eac-05a4-44e1-a3a9-18571836189b service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:03.986481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5eac-05a4-44e1-a3a9-18571836189b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:03.995193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5eac-05a4-44e1-a3a9-18571836189b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:03.996634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5eac-05a4-44e1-a3a9-18571836189b service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:04.005489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 731/1453] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:06.433158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e334d-1346-4c20-a452-0db22eeb42d3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:06.433694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e334d-1346-4c20-a452-0db22eeb42d3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:06.433694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e334d-1346-4c20-a452-0db22eeb42d3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:06.435564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 723/1454] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:06.441348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d60e43-be5f-44e4-86cf-66c2e6b9db4f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:06.441734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d60e43-be5f-44e4-86cf-66c2e6b9db4f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:06.441924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d60e43-be5f-44e4-86cf-66c2e6b9db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:06.459636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d4d60e43-be5f-44e4-86cf-66c2e6b9db4f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:06.461436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d4d60e43-be5f-44e4-86cf-66c2e6b9db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:06.469022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 732/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:06.508476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e334d-1346-4c20-a452-0db22eeb42d3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:06.518809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e334d-1346-4c20-a452-0db22eeb42d3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:06.522340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6401-459c-4e34-82e1-3a1b2aea5761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:06.523601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6401-459c-4e34-82e1-3a1b2aea5761 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:06.523884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6401-459c-4e34-82e1-3a1b2aea5761 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:06.524160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6401-459c-4e34-82e1-3a1b2aea5761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:06.533070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e6401-459c-4e34-82e1-3a1b2aea5761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:06.534519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e6401-459c-4e34-82e1-3a1b2aea5761 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:06.543580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 724/1456] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:08.930101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8961a9-9b20-4526-a591-859ab18c16f5 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:08.930652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8961a9-9b20-4526-a591-859ab18c16f5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:08.930652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8961a9-9b20-4526-a591-859ab18c16f5 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:08.932423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 733/1457] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:08.938631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302819d7-925a-42db-96c8-4d4b9b34c502 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:08.939109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302819d7-925a-42db-96c8-4d4b9b34c502 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:08.939210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302819d7-925a-42db-96c8-4d4b9b34c502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:08.956977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-302819d7-925a-42db-96c8-4d4b9b34c502 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:08.958132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-302819d7-925a-42db-96c8-4d4b9b34c502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:08.965768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 725/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:09.005004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8961a9-9b20-4526-a591-859ab18c16f5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:09.015965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8961a9-9b20-4526-a591-859ab18c16f5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:09.019410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edf569-a536-43f2-be17-467eb29b4825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:09.020021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edf569-a536-43f2-be17-467eb29b4825 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:09.020295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edf569-a536-43f2-be17-467eb29b4825 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:09.020560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edf569-a536-43f2-be17-467eb29b4825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:09.029110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edf569-a536-43f2-be17-467eb29b4825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:09.030526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edf569-a536-43f2-be17-467eb29b4825 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:09.039395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 734/1459] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:09:11.495263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7132-ea8b-4485-9956-ff7dd2da508c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:11.495829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7132-ea8b-4485-9956-ff7dd2da508c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:11.495829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7132-ea8b-4485-9956-ff7dd2da508c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:11.497588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 726/1460] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:11.503545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447654a-6184-413d-a60b-33922a040403 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:11.503961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447654a-6184-413d-a60b-33922a040403 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:11.504096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447654a-6184-413d-a60b-33922a040403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:11.521791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4447654a-6184-413d-a60b-33922a040403 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:11.523579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4447654a-6184-413d-a60b-33922a040403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:11.531011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 735/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:11.570557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7132-ea8b-4485-9956-ff7dd2da508c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:11.581022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7132-ea8b-4485-9956-ff7dd2da508c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:11.584496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91bc50-1bcc-4087-8b00-cf75fc67ca44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:11.585116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91bc50-1bcc-4087-8b00-cf75fc67ca44 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:11.586034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91bc50-1bcc-4087-8b00-cf75fc67ca44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:11.586308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91bc50-1bcc-4087-8b00-cf75fc67ca44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:11.594906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91bc50-1bcc-4087-8b00-cf75fc67ca44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:11.596390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91bc50-1bcc-4087-8b00-cf75fc67ca44 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:11.605393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 727/1462] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:13.987479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b04e-0b9c-4d20-b828-2b71a7d6e58a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:13.987994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b04e-0b9c-4d20-b828-2b71a7d6e58a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:13.987994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b04e-0b9c-4d20-b828-2b71a7d6e58a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:13.989683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 736/1463] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:13.996145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184e6d-95ea-4fa6-b2c4-9e239d26a853 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:13.996587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184e6d-95ea-4fa6-b2c4-9e239d26a853 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:13.996696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184e6d-95ea-4fa6-b2c4-9e239d26a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:14.013757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-85184e6d-95ea-4fa6-b2c4-9e239d26a853 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:14.014950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-85184e6d-95ea-4fa6-b2c4-9e239d26a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:14.022485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 728/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:14.060501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b04e-0b9c-4d20-b828-2b71a7d6e58a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:14.071031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b04e-0b9c-4d20-b828-2b71a7d6e58a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:14.074563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96780307-a309-48df-9dc3-18b1efac8de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:14.075222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780307-a309-48df-9dc3-18b1efac8de9 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:14.075508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780307-a309-48df-9dc3-18b1efac8de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:14.075784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780307-a309-48df-9dc3-18b1efac8de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:14.084460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96780307-a309-48df-9dc3-18b1efac8de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:14.086415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96780307-a309-48df-9dc3-18b1efac8de9 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:14.095476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 737/1465] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:16.479456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92678285-532a-4d4d-8f9c-05c36d53cc62 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:16.479995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92678285-532a-4d4d-8f9c-05c36d53cc62 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:16.479995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92678285-532a-4d4d-8f9c-05c36d53cc62 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:16.481766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 729/1466] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:16.488025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838147-b260-49e0-a6bc-7aaab0bc403d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:16.488400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838147-b260-49e0-a6bc-7aaab0bc403d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:16.488581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838147-b260-49e0-a6bc-7aaab0bc403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:16.505980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e0838147-b260-49e0-a6bc-7aaab0bc403d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:16.507196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e0838147-b260-49e0-a6bc-7aaab0bc403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:16.514814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 738/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:16.553618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92678285-532a-4d4d-8f9c-05c36d53cc62 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:16.564007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92678285-532a-4d4d-8f9c-05c36d53cc62 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:16.567500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639954-98b1-4271-8975-0e6f7847f6ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:16.568116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639954-98b1-4271-8975-0e6f7847f6ad service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:16.568394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639954-98b1-4271-8975-0e6f7847f6ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:16.568668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639954-98b1-4271-8975-0e6f7847f6ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:16.577214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c639954-98b1-4271-8975-0e6f7847f6ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:16.578627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c639954-98b1-4271-8975-0e6f7847f6ad service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:16.588046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 730/1468] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:19.031131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7a83-c600-40e1-b870-97c74f8801c4 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:19.031654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7a83-c600-40e1-b870-97c74f8801c4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:19.031654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7a83-c600-40e1-b870-97c74f8801c4 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:19.033415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 739/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:19.039864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1e51-3bd3-42eb-a505-a18b96a87cb9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:19.040263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1e51-3bd3-42eb-a505-a18b96a87cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:19.040422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1e51-3bd3-42eb-a505-a18b96a87cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:19.058995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-112d1e51-3bd3-42eb-a505-a18b96a87cb9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:19.060201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-112d1e51-3bd3-42eb-a505-a18b96a87cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:19.067881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 731/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:19.105398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe7a83-c600-40e1-b870-97c74f8801c4 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:19.115973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe7a83-c600-40e1-b870-97c74f8801c4 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:19.119929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa24be-cebc-4cd1-a366-26997d7baf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:19.120536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa24be-cebc-4cd1-a366-26997d7baf15 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:19.120814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa24be-cebc-4cd1-a366-26997d7baf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:19.121085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa24be-cebc-4cd1-a366-26997d7baf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:19.129457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa24be-cebc-4cd1-a366-26997d7baf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:19.130865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa24be-cebc-4cd1-a366-26997d7baf15 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:19.140337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 740/1471] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:21.473460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b713-73af-4374-92dc-f91ca73b5fe9 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:21.474002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b713-73af-4374-92dc-f91ca73b5fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:21.474002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b713-73af-4374-92dc-f91ca73b5fe9 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:21.475881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 732/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:09:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:21.481999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2fd68-f416-4420-ac28-4c53a0c9cd2c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:21.482429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2fd68-f416-4420-ac28-4c53a0c9cd2c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:21.482535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2fd68-f416-4420-ac28-4c53a0c9cd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:21.500135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9af2fd68-f416-4420-ac28-4c53a0c9cd2c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:21.501307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9af2fd68-f416-4420-ac28-4c53a0c9cd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:21.509742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 741/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:09:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:09:21.550381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24b713-73af-4374-92dc-f91ca73b5fe9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:21.560702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24b713-73af-4374-92dc-f91ca73b5fe9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:21.564180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b6688-f63a-4428-832d-7039703ca6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:21.564795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b6688-f63a-4428-832d-7039703ca6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:21.565108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b6688-f63a-4428-832d-7039703ca6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:21.565375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b6688-f63a-4428-832d-7039703ca6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:21.574555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b6688-f63a-4428-832d-7039703ca6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:21.576015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b6688-f63a-4428-832d-7039703ca6d9 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:21.585688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 733/1474] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:38.713836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cfe1-a6f6-4217-91ea-976a1e30ca3b None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:38.714398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cfe1-a6f6-4217-91ea-976a1e30ca3b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:38.714398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cfe1-a6f6-4217-91ea-976a1e30ca3b None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:38.716248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 742/1475] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:38.722058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36c9cb-c9cf-4296-88d0-6510de7ca661 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:38.722456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36c9cb-c9cf-4296-88d0-6510de7ca661 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:38.722631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36c9cb-c9cf-4296-88d0-6510de7ca661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:38.740465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bb36c9cb-c9cf-4296-88d0-6510de7ca661 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:38.741637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb36c9cb-c9cf-4296-88d0-6510de7ca661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:38.749475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 734/1476] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:38.798532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9c261-9d64-4c42-8c8d-5cb45eadbc02 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:38.798817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9c261-9d64-4c42-8c8d-5cb45eadbc02 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:38.799120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9c261-9d64-4c42-8c8d-5cb45eadbc02 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:38.800864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 743/1477] 10.222.0.43 () {54 vars in 962 bytes} [Tue Dec 14 03:09:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:38.806741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51eee-024d-4043-88f6-d3f254658647 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:38.807017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51eee-024d-4043-88f6-d3f254658647 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:38.807307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51eee-024d-4043-88f6-d3f254658647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:38.824994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e8c51eee-024d-4043-88f6-d3f254658647 None None] MFA Rules not processed for user `1a9f0d0a342649658a174da2d495fe8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:38.826175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e8c51eee-024d-4043-88f6-d3f254658647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:38.832548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 735/1478] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Dec 14 03:09:38 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:38.840474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9c261-9d64-4c42-8c8d-5cb45eadbc02 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:38.851385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9c261-9d64-4c42-8c8d-5cb45eadbc02 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:38.854823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3a90-fbc2-44af-80fc-75983eaf0ca4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:38.855465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3a90-fbc2-44af-80fc-75983eaf0ca4 service glance] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:38.855748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3a90-fbc2-44af-80fc-75983eaf0ca4 service glance] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:38.856024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3a90-fbc2-44af-80fc-75983eaf0ca4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:38.864802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab3a90-fbc2-44af-80fc-75983eaf0ca4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:38.866229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab3a90-fbc2-44af-80fc-75983eaf0ca4 service glance] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:38.875282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 744/1479] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:41.333190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faae090-2fdf-4091-a6c2-6ef7563d3cbd None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:41.333775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faae090-2fdf-4091-a6c2-6ef7563d3cbd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:41.333775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faae090-2fdf-4091-a6c2-6ef7563d3cbd None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:41.335602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 736/1480] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:41.341521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64691df2-d133-4247-adcb-52fa58ca9982 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:41.341943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64691df2-d133-4247-adcb-52fa58ca9982 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:41.342077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64691df2-d133-4247-adcb-52fa58ca9982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:41.359497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-64691df2-d133-4247-adcb-52fa58ca9982 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:41.360672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-64691df2-d133-4247-adcb-52fa58ca9982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:41.369130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 745/1481] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:41.393835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faae090-2fdf-4091-a6c2-6ef7563d3cbd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:41.405785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faae090-2fdf-4091-a6c2-6ef7563d3cbd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:41.410142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b85a90-2090-4f1e-888a-799bebee0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:41.410761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b85a90-2090-4f1e-888a-799bebee0a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:41.411062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b85a90-2090-4f1e-888a-799bebee0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:41.411336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b85a90-2090-4f1e-888a-799bebee0a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:41.412070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b85a90-2090-4f1e-888a-799bebee0a80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:41.413913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b85a90-2090-4f1e-888a-799bebee0a80 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:41.432637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 737/1482] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Dec 14 03:09:41 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:09:43.815926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a43b-11c6-4786-8092-c1a016efbe44 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:43.816471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a43b-11c6-4786-8092-c1a016efbe44 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:43.816471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a43b-11c6-4786-8092-c1a016efbe44 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:43.818265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 746/1483] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:43.824124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1813d2-5708-46ad-a110-149353207f74 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:43.824531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1813d2-5708-46ad-a110-149353207f74 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:43.824676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1813d2-5708-46ad-a110-149353207f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:43.842114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3e1813d2-5708-46ad-a110-149353207f74 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:43.843263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e1813d2-5708-46ad-a110-149353207f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:43.851445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 738/1484] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:43.894810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a43b-11c6-4786-8092-c1a016efbe44 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:43.908956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a43b-11c6-4786-8092-c1a016efbe44 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:43.914734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e310-0221-44e7-82de-ba62e76ac32b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:43.915386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e310-0221-44e7-82de-ba62e76ac32b service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:43.915666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e310-0221-44e7-82de-ba62e76ac32b service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:43.915940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e310-0221-44e7-82de-ba62e76ac32b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:43.923659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e310-0221-44e7-82de-ba62e76ac32b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:43.925222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e310-0221-44e7-82de-ba62e76ac32b service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:43.934811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 747/1485] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:46.575450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154183cd-447d-4627-835f-913dfa356571 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:46.576017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154183cd-447d-4627-835f-913dfa356571 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:46.576017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154183cd-447d-4627-835f-913dfa356571 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:46.577743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 739/1486] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:46.583445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09148df-06b6-4be9-a6c7-68b68c30e95a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:46.583910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09148df-06b6-4be9-a6c7-68b68c30e95a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:46.584515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09148df-06b6-4be9-a6c7-68b68c30e95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:46.602262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d09148df-06b6-4be9-a6c7-68b68c30e95a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:46.603460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d09148df-06b6-4be9-a6c7-68b68c30e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:46.611064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 748/1487] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:46.647762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154183cd-447d-4627-835f-913dfa356571 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:46.658229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154183cd-447d-4627-835f-913dfa356571 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:46.661683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd32593-6b28-44da-aee6-cdbb08bbb792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:46.662864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd32593-6b28-44da-aee6-cdbb08bbb792 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:46.663173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd32593-6b28-44da-aee6-cdbb08bbb792 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:46.663444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd32593-6b28-44da-aee6-cdbb08bbb792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:46.672340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd32593-6b28-44da-aee6-cdbb08bbb792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:46.673751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd32593-6b28-44da-aee6-cdbb08bbb792 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:46.682776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 740/1488] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:09:49.096805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b30d-aa61-4c63-82f1-09252512145d None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:49.097347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b30d-aa61-4c63-82f1-09252512145d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:49.097464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b30d-aa61-4c63-82f1-09252512145d None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:49.099259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 749/1489] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:49.105105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917559-6cdd-4e66-8456-03e17bccc488 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:49.105507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917559-6cdd-4e66-8456-03e17bccc488 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:49.105662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917559-6cdd-4e66-8456-03e17bccc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:49.123727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a0917559-6cdd-4e66-8456-03e17bccc488 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:49.125743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a0917559-6cdd-4e66-8456-03e17bccc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:49.136588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 741/1490] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:49.175961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622b30d-aa61-4c63-82f1-09252512145d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:49.186277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622b30d-aa61-4c63-82f1-09252512145d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:49.189767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0be680-3698-4194-bfed-370fedf12130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:49.190381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0be680-3698-4194-bfed-370fedf12130 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:49.190659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0be680-3698-4194-bfed-370fedf12130 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:49.190930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0be680-3698-4194-bfed-370fedf12130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:49.200123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0be680-3698-4194-bfed-370fedf12130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:49.201543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0be680-3698-4194-bfed-370fedf12130 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:49.211023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 750/1491] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:51.624519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7f23-dc83-4263-8311-bea79661ace0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:51.624989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7f23-dc83-4263-8311-bea79661ace0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:51.625095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7f23-dc83-4263-8311-bea79661ace0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:51.626849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 742/1492] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:51.633414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9e5d-5d21-49e3-a7c4-3daf3c58b1cb None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:51.633818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9e5d-5d21-49e3-a7c4-3daf3c58b1cb None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:51.633961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9e5d-5d21-49e3-a7c4-3daf3c58b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:51.651173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e13c9e5d-5d21-49e3-a7c4-3daf3c58b1cb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:51.652354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e13c9e5d-5d21-49e3-a7c4-3daf3c58b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:51.660048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 751/1493] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:51.702592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf7f23-dc83-4263-8311-bea79661ace0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:51.704301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7ccf7f23-dc83-4263-8311-bea79661ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:51.716879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf7f23-dc83-4263-8311-bea79661ace0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:51.720369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1dd7d-b212-4a6e-9971-c61c70e3065d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:51.720983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1dd7d-b212-4a6e-9971-c61c70e3065d service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:51.721262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1dd7d-b212-4a6e-9971-c61c70e3065d service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:51.721534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1dd7d-b212-4a6e-9971-c61c70e3065d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:51.730126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1dd7d-b212-4a6e-9971-c61c70e3065d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:51.731505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1dd7d-b212-4a6e-9971-c61c70e3065d service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:51.741220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 743/1494] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:09:54.337325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbdd51-64a2-4b2a-8123-d05c2f2a4c78 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:54.337905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbdd51-64a2-4b2a-8123-d05c2f2a4c78 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:54.337905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbdd51-64a2-4b2a-8123-d05c2f2a4c78 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:54.339672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 752/1495] 10.222.0.43 () {54 vars in 926 bytes} [Tue Dec 14 03:09:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:09:54.345379 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b8b1b-2160-4403-8e14-da8a349d4be5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:54.345764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b8b1b-2160-4403-8e14-da8a349d4be5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:54.345925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b8b1b-2160-4403-8e14-da8a349d4be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:54.363374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d84b8b1b-2160-4403-8e14-da8a349d4be5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:09:54.364560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d84b8b1b-2160-4403-8e14-da8a349d4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:09:54.372174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 744/1496] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Dec 14 03:09:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:09:54.412280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbdd51-64a2-4b2a-8123-d05c2f2a4c78 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:09:54.422782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbdd51-64a2-4b2a-8123-d05c2f2a4c78 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:09:54.426275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91fb42-6281-42d6-b1b0-d4f430850b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:09:54.426892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91fb42-6281-42d6-b1b0-d4f430850b81 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:09:54.427204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91fb42-6281-42d6-b1b0-d4f430850b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:09:54.427501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91fb42-6281-42d6-b1b0-d4f430850b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:09:54.436144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91fb42-6281-42d6-b1b0-d4f430850b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:09:54.437563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91fb42-6281-42d6-b1b0-d4f430850b81 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:09:54.447120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 753/1497] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:09:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:11:05.993453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:05.994003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:05.994003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.011231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:11:06.012375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:11:06.020693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 745/1498] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:11:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:11:06.028568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.029068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.029171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.046891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:11:06.048080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:11:06.056084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 754/1499] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:11:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:11:06.060359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.069458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b39ab-7a81-4e84-a7c2-0f6e435d5129 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.073835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.074459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.074737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.075008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.075746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:11:06.076045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.077603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.089152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 746/1500] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:11:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:11:06.097696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.106466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baa279-bfcd-41b1-a9de-c60d35f3e5dc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.110887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.111548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.111829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.112099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.113093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.114971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.150285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 755/1501] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:11:06 2021] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:11:06.154425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.164525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bae04-6868-4ac8-af80-6d8b833e94dd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.217603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.218251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.218533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.218807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.219529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.221431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.241224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 747/1502] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:11:06 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:11:06.245804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.256210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1beef-1944-4ea5-806f-c099f78686de admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.260717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.261362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.261642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.261917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.262653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.264311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.277765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 756/1503] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:11:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:11:06.281621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.291102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6654ce-ff52-4e87-adc0-a8d3752effc4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.295779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41fd89-2eed-41ad-8a3f-ec83b11f06bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.296414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fd89-2eed-41ad-8a3f-ec83b11f06bf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.296694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fd89-2eed-41ad-8a3f-ec83b11f06bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.296968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fd89-2eed-41ad-8a3f-ec83b11f06bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.297697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41fd89-2eed-41ad-8a3f-ec83b11f06bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.299309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41fd89-2eed-41ad-8a3f-ec83b11f06bf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.312061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 748/1504] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:11:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:11:06.316530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.326069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b64d7-b196-4638-8b40-caa97d6bf296 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.330564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.331501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.332280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.332556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] PATH_INFO: `/v3/projects/1e15ca78bdf74384920d15239a125285/users/4f34de5de7c148aab19b150162f22c91/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.348511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e15ca78bdf74384920d15239a125285, user_id=4f34de5de7c148aab19b150162f22c91, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.351195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.364234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 757/1505] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:11:06 2021] PUT /identity/v3/projects/1e15ca78bdf74384920d15239a125285/users/4f34de5de7c148aab19b150162f22c91/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:11:06.375292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e421d-38ff-4ee5-a0b0-0f2df00a82b9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.375586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e421d-38ff-4ee5-a0b0-0f2df00a82b9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.375864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e421d-38ff-4ee5-a0b0-0f2df00a82b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.401849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-970e421d-38ff-4ee5-a0b0-0f2df00a82b9 None None] MFA Rules not processed for user `4f34de5de7c148aab19b150162f22c91`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:11:06.403122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-970e421d-38ff-4ee5-a0b0-0f2df00a82b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:11:06.463450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 749/1506] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:11:06 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:11:06.475936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.542089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5abed0-8c04-462a-951c-0a63ee8e66c2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.547427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.548058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.548343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.548614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.556134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.557704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.566605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 758/1507] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:11:06 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:11:06.633255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b7c7-cb0e-4f04-8077-51867e79b18d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.633573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b7c7-cb0e-4f04-8077-51867e79b18d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.633855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b7c7-cb0e-4f04-8077-51867e79b18d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.635574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 750/1508] 10.222.0.43 () {52 vars in 829 bytes} [Tue Dec 14 03:11:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:11:06.638997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.698436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ddaf-e879-4390-b6fb-16836d4e9cbb service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.702962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.703873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.704157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.704431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] PATH_INFO: `/v3/users/4f34de5de7c148aab19b150162f22c91` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.705612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f34de5de7c148aab19b150162f22c91)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.706640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:11:06.706640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:11:06.706640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:11:06.707862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.770269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f34de5de7c148aab19b150162f22c91'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:06.770904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f34de5de7c148aab19b150162f22c91'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:06.789793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f34de5de7c148aab19b150162f22c91'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:06.790568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f34de5de7c148aab19b150162f22c91'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:06.799712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f34de5de7c148aab19b150162f22c91'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:06.817538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 759/1509] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:11:06 2021] DELETE /identity/v3/users/4f34de5de7c148aab19b150162f22c91 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:11:06.821945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616371-8d47-4129-937c-68770673d850 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.822258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616371-8d47-4129-937c-68770673d850 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.822537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616371-8d47-4129-937c-68770673d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.840691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3c616371-8d47-4129-937c-68770673d850 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:11:06.841885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3c616371-8d47-4129-937c-68770673d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:11:06.898157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 751/1510] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:11:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:11:06.907892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:06.909294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:11:06.963604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b43c-d327-42ef-809e-962672c7be2b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:06.967203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63695543-cac0-4c84-965e-128cc3783f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:06.967831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695543-cac0-4c84-965e-128cc3783f83 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:06.968113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695543-cac0-4c84-965e-128cc3783f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:06.968388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695543-cac0-4c84-965e-128cc3783f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:06.977598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63695543-cac0-4c84-965e-128cc3783f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:06.979028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63695543-cac0-4c84-965e-128cc3783f83 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:06.988959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 760/1511] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:11:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:11:07.318113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616371-8d47-4129-937c-68770673d850 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:11:07.319569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3c616371-8d47-4129-937c-68770673d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:11:07.332026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616371-8d47-4129-937c-68770673d850 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:11:07.337827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:11:07.338676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:11:07.338994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:11:07.339244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] PATH_INFO: `/v3/projects/1e15ca78bdf74384920d15239a125285` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:11:07.340613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e15ca78bdf74384920d15239a125285)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:11:07.342915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:11:07.342915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:11:07.342915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:11:07.344357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:11:07.402405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e15ca78bdf74384920d15239a125285', 'request_id': 'req-7aa2bff0-f5c6-409b-8554-31071329b19d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:07.415781 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e15ca78bdf74384920d15239a125285', 'request_id': 'req-7aa2bff0-f5c6-409b-8554-31071329b19d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:07.425371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e15ca78bdf74384920d15239a125285', 'request_id': 'req-7aa2bff0-f5c6-409b-8554-31071329b19d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:07.436103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] The token cache is being invalidate because project 1e15ca78bdf74384920d15239a125285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:11:07.436390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:07.437091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7aa2bff0-f5c6-409b-8554-31071329b19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:11:07.438704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 752/1512] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:11:07 2021] DELETE /identity/v3/projects/1e15ca78bdf74384920d15239a125285 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:12:35.562876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43278cfc-0cbd-452c-be8d-c5b1fb761b91 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:35.563509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43278cfc-0cbd-452c-be8d-c5b1fb761b91 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:35.563509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43278cfc-0cbd-452c-be8d-c5b1fb761b91 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:35.565295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 761/1513] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:12:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:35.570930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211831-b4b1-42b1-82b0-3b01d0516c02 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:35.571387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211831-b4b1-42b1-82b0-3b01d0516c02 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:35.571513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211831-b4b1-42b1-82b0-3b01d0516c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:35.589856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ed211831-b4b1-42b1-82b0-3b01d0516c02 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:35.591067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ed211831-b4b1-42b1-82b0-3b01d0516c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:35.646059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 753/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:35.807826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43278cfc-0cbd-452c-be8d-c5b1fb761b91 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:35.809525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-43278cfc-0cbd-452c-be8d-c5b1fb761b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:35.886377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43278cfc-0cbd-452c-be8d-c5b1fb761b91 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:35.891710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08aca6-a1ee-4023-82e0-b70883b31ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:35.892348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08aca6-a1ee-4023-82e0-b70883b31ac0 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:35.892631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08aca6-a1ee-4023-82e0-b70883b31ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:35.892906 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08aca6-a1ee-4023-82e0-b70883b31ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:35.901350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08aca6-a1ee-4023-82e0-b70883b31ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:35.903028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08aca6-a1ee-4023-82e0-b70883b31ac0 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:35.912724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 762/1515] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:12:36.404836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5f066-b747-46dd-9676-7249b8025200 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:36.405132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5f066-b747-46dd-9676-7249b8025200 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:36.405411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5f066-b747-46dd-9676-7249b8025200 None None] PATH_INFO: `/v3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:36.406771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 754/1516] 10.222.0.20 () {54 vars in 925 bytes} [Tue Dec 14 03:12:36 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:12:36.414213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10d88-c780-4f2e-8543-e48ad3573152 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:36.414501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10d88-c780-4f2e-8543-e48ad3573152 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:36.414777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10d88-c780-4f2e-8543-e48ad3573152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:36.432568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b4a10d88-c780-4f2e-8543-e48ad3573152 None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:36.433778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b4a10d88-c780-4f2e-8543-e48ad3573152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:36.494102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 763/1517] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Dec 14 03:12:36 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:37.399940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1e21-d6ee-4c00-ad7d-706bbc9b91a6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:37.400501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1e21-d6ee-4c00-ad7d-706bbc9b91a6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:37.400501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1e21-d6ee-4c00-ad7d-706bbc9b91a6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:37.402317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 755/1518] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:12:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:37.407633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7fb5d-31f1-4611-9fc4-d9f3069ad088 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:37.408062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7fb5d-31f1-4611-9fc4-d9f3069ad088 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:37.408190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7fb5d-31f1-4611-9fc4-d9f3069ad088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:37.428134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9bc7fb5d-31f1-4611-9fc4-d9f3069ad088 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:37.429315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9bc7fb5d-31f1-4611-9fc4-d9f3069ad088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:37.436890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 764/1519] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:12:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:37.587656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1e21-d6ee-4c00-ad7d-706bbc9b91a6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:37.602180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1e21-d6ee-4c00-ad7d-706bbc9b91a6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:37.607539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9566d-c99d-4639-86ab-e2b9c3b0a641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:37.608151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9566d-c99d-4639-86ab-e2b9c3b0a641 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:37.608429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9566d-c99d-4639-86ab-e2b9c3b0a641 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:37.608696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9566d-c99d-4639-86ab-e2b9c3b0a641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:37.616827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9566d-c99d-4639-86ab-e2b9c3b0a641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:37.618404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9566d-c99d-4639-86ab-e2b9c3b0a641 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:37.627629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 756/1520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:12:45.085445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faaa41-8ebf-4059-8128-635d36a8cb62 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:45.085967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faaa41-8ebf-4059-8128-635d36a8cb62 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:45.086099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faaa41-8ebf-4059-8128-635d36a8cb62 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:45.087843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 765/1521] 10.222.0.43 () {54 vars in 960 bytes} [Tue Dec 14 03:12:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:45.093085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c877e-2ad1-469a-aefe-ea354e79f100 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:45.093501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c877e-2ad1-469a-aefe-ea354e79f100 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:45.093660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c877e-2ad1-469a-aefe-ea354e79f100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:45.111666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bb0c877e-2ad1-469a-aefe-ea354e79f100 None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:45.112840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb0c877e-2ad1-469a-aefe-ea354e79f100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:45.121925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 757/1522] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Dec 14 03:12:45 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:45.129606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faaa41-8ebf-4059-8128-635d36a8cb62 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:45.143310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faaa41-8ebf-4059-8128-635d36a8cb62 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:45.149046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33016c4-5cd0-4647-afe8-4a37b74f6c0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:45.149660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33016c4-5cd0-4647-afe8-4a37b74f6c0e service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:45.149945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33016c4-5cd0-4647-afe8-4a37b74f6c0e service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:45.150215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33016c4-5cd0-4647-afe8-4a37b74f6c0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:45.158314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33016c4-5cd0-4647-afe8-4a37b74f6c0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:45.159921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33016c4-5cd0-4647-afe8-4a37b74f6c0e service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:45.169136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 766/1523] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:45 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:12:49.518600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49419624-22a3-469e-9217-7166cca0ba88 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:49.519231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49419624-22a3-469e-9217-7166cca0ba88 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:49.519231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49419624-22a3-469e-9217-7166cca0ba88 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:49.520996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:12:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:49.526793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c396-2dd1-4c34-84a0-db26f5b50408 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:49.527237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c396-2dd1-4c34-84a0-db26f5b50408 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:49.527348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c396-2dd1-4c34-84a0-db26f5b50408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:49.545256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5bb4c396-2dd1-4c34-84a0-db26f5b50408 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:49.546417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5bb4c396-2dd1-4c34-84a0-db26f5b50408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:49.554067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:12:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:49.708851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49419624-22a3-469e-9217-7166cca0ba88 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:49.723617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49419624-22a3-469e-9217-7166cca0ba88 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:49.729009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0760a-a0ad-4ee4-a998-458d621eff69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:49.729632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0760a-a0ad-4ee4-a998-458d621eff69 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:49.729917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0760a-a0ad-4ee4-a998-458d621eff69 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:49.730193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0760a-a0ad-4ee4-a998-458d621eff69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:49.738333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0760a-a0ad-4ee4-a998-458d621eff69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:49.739932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0760a-a0ad-4ee4-a998-458d621eff69 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:49.749139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 759/1526] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:12:51.235240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3db9-8676-4a23-9b47-71e0d2426fc7 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:51.235771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3db9-8676-4a23-9b47-71e0d2426fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:51.235771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3db9-8676-4a23-9b47-71e0d2426fc7 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:51.237567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 901 bytes} [Tue Dec 14 03:12:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:51.243011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf83a-80be-47aa-8c95-fe0edfac3591 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:51.243485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf83a-80be-47aa-8c95-fe0edfac3591 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:51.243594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf83a-80be-47aa-8c95-fe0edfac3591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:51.261413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-30bbf83a-80be-47aa-8c95-fe0edfac3591 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:51.262575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-30bbf83a-80be-47aa-8c95-fe0edfac3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:51.270179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 998 bytes} [Tue Dec 14 03:12:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:51.449574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff3db9-8676-4a23-9b47-71e0d2426fc7 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:51.463288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff3db9-8676-4a23-9b47-71e0d2426fc7 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:51.468541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e3dc7-18fd-4683-b39c-ff0c64cc007a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:51.469276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e3dc7-18fd-4683-b39c-ff0c64cc007a service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:51.469557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e3dc7-18fd-4683-b39c-ff0c64cc007a service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:51.469828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e3dc7-18fd-4683-b39c-ff0c64cc007a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:51.477834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e3dc7-18fd-4683-b39c-ff0c64cc007a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:51.479511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e3dc7-18fd-4683-b39c-ff0c64cc007a service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:51.489070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 769/1529] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:12:55.695959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da5fce-5c9c-42f3-9aee-e951b38fa06c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:55.696442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da5fce-5c9c-42f3-9aee-e951b38fa06c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:55.696541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da5fce-5c9c-42f3-9aee-e951b38fa06c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:55.698364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:12:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:55.704104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3295-adcd-430a-8191-fcda4ccbed02 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:55.704508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3295-adcd-430a-8191-fcda4ccbed02 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:55.704676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3295-adcd-430a-8191-fcda4ccbed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:55.722730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0bde3295-adcd-430a-8191-fcda4ccbed02 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:55.723951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0bde3295-adcd-430a-8191-fcda4ccbed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:55.732245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:12:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:55.774786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da5fce-5c9c-42f3-9aee-e951b38fa06c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:55.776504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-80da5fce-5c9c-42f3-9aee-e951b38fa06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:55.830228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da5fce-5c9c-42f3-9aee-e951b38fa06c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:55.833705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda080f5-5a01-4000-b562-43537ded843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:55.834324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda080f5-5a01-4000-b562-43537ded843c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:55.835267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda080f5-5a01-4000-b562-43537ded843c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:55.835542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda080f5-5a01-4000-b562-43537ded843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:55.844057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda080f5-5a01-4000-b562-43537ded843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:55.845454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda080f5-5a01-4000-b562-43537ded843c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:55.854425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 762/1532] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:12:58.192358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1cdb-f412-42b8-9302-aa6beabbef28 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:58.192930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1cdb-f412-42b8-9302-aa6beabbef28 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:58.192930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1cdb-f412-42b8-9302-aa6beabbef28 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:58.195398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 771/1533] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:12:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:12:58.201524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1837dd-8cd4-4421-91c2-525b9d96764f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:58.201982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1837dd-8cd4-4421-91c2-525b9d96764f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:58.202101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1837dd-8cd4-4421-91c2-525b9d96764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:58.220405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5b1837dd-8cd4-4421-91c2-525b9d96764f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:12:58.221598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5b1837dd-8cd4-4421-91c2-525b9d96764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:58.229906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 763/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:12:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:12:58.267110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1cdb-f412-42b8-9302-aa6beabbef28 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:12:58.268762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8bcf1cdb-f412-42b8-9302-aa6beabbef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:12:58.281805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1cdb-f412-42b8-9302-aa6beabbef28 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:12:58.285271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da45544-5780-490e-bca1-e67d4c4fce3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:12:58.285882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45544-5780-490e-bca1-e67d4c4fce3c service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:12:58.286160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45544-5780-490e-bca1-e67d4c4fce3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:12:58.286432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45544-5780-490e-bca1-e67d4c4fce3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:12:58.295613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45544-5780-490e-bca1-e67d4c4fce3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:12:58.297022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45544-5780-490e-bca1-e67d4c4fce3c service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:12:58.306435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 772/1535] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:12:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:13:02.135460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b05a2-8b67-4106-9b13-49a7260ed5d8 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:02.136061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b05a2-8b67-4106-9b13-49a7260ed5d8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:02.136061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b05a2-8b67-4106-9b13-49a7260ed5d8 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:02.137774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 764/1536] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:13:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:13:02.143571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a872-a8f8-4c89-9f99-19c9146b837f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:02.143964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a872-a8f8-4c89-9f99-19c9146b837f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:02.144174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a872-a8f8-4c89-9f99-19c9146b837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:02.162057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-27d7a872-a8f8-4c89-9f99-19c9146b837f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:13:02.163933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-27d7a872-a8f8-4c89-9f99-19c9146b837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:13:02.171449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 773/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:13:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:13:02.220950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b05a2-8b67-4106-9b13-49a7260ed5d8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:13:02.222597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a41b05a2-8b67-4106-9b13-49a7260ed5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:13:02.276824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b05a2-8b67-4106-9b13-49a7260ed5d8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:13:02.280325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239e50-ceb1-4fbb-8b71-f109007de73c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:13:02.280969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239e50-ceb1-4fbb-8b71-f109007de73c service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:02.281246 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239e50-ceb1-4fbb-8b71-f109007de73c service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:02.281520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239e50-ceb1-4fbb-8b71-f109007de73c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:02.290499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9239e50-ceb1-4fbb-8b71-f109007de73c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:13:02.291922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9239e50-ceb1-4fbb-8b71-f109007de73c service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:13:02.300795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 765/1538] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:13:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:13:04.625844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41409506-089e-471b-b87e-4cbfd873ebe5 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:04.626409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41409506-089e-471b-b87e-4cbfd873ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:04.626409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41409506-089e-471b-b87e-4cbfd873ebe5 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:04.628182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 774/1539] 127.0.0.1 () {54 vars in 916 bytes} [Tue Dec 14 03:13:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:13:04.634461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8636-9189-4ccb-9f67-280815b4a097 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:04.634845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8636-9189-4ccb-9f67-280815b4a097 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:04.635019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8636-9189-4ccb-9f67-280815b4a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:04.655095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0dea8636-9189-4ccb-9f67-280815b4a097 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:13:04.656301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0dea8636-9189-4ccb-9f67-280815b4a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:13:04.664108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 766/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Dec 14 03:13:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:13:04.713486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8e2d-b3b2-4df4-93d6-81c53da9aa5a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:04.713769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8e2d-b3b2-4df4-93d6-81c53da9aa5a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:04.714043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8e2d-b3b2-4df4-93d6-81c53da9aa5a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:04.715867 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 775/1541] 10.222.0.43 () {54 vars in 963 bytes} [Tue Dec 14 03:13:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:13:04.720927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8007-0281-47ab-a40b-d6955ab6d1ea None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:04.721214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8007-0281-47ab-a40b-d6955ab6d1ea None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:04.721489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8007-0281-47ab-a40b-d6955ab6d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:04.739354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3e8b8007-0281-47ab-a40b-d6955ab6d1ea None None] MFA Rules not processed for user `647e47606fc9438cb580f58fe7daae4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:13:04.740563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e8b8007-0281-47ab-a40b-d6955ab6d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:13:04.746784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 767/1542] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Dec 14 03:13:04 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:13:04.754320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b8e2d-b3b2-4df4-93d6-81c53da9aa5a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:13:04.765538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b8e2d-b3b2-4df4-93d6-81c53da9aa5a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:13:04.769137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05692c-f2e3-4637-ac55-82d4c21c31a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:13:04.769757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05692c-f2e3-4637-ac55-82d4c21c31a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:13:04.770037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05692c-f2e3-4637-ac55-82d4c21c31a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:13:04.770305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05692c-f2e3-4637-ac55-82d4c21c31a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:13:04.779428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05692c-f2e3-4637-ac55-82d4c21c31a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:13:04.780849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05692c-f2e3-4637-ac55-82d4c21c31a5 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:13:04.790414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 776/1543] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:13:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:27.836927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771a7d6-8dc6-43f4-a131-bbea4a16edf1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:27.838231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771a7d6-8dc6-43f4-a131-bbea4a16edf1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:27.838726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771a7d6-8dc6-43f4-a131-bbea4a16edf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:27.864111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4771a7d6-8dc6-43f4-a131-bbea4a16edf1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:27.865868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4771a7d6-8dc6-43f4-a131-bbea4a16edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:27.878284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 768/1544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:27.886375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54540b28-1de5-4354-9b48-330734c74dc1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:27.887363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54540b28-1de5-4354-9b48-330734c74dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:27.887870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54540b28-1de5-4354-9b48-330734c74dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:27.895681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb595ab-17f2-4bd7-9da5-00d8d491c54f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:27.904469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb595ab-17f2-4bd7-9da5-00d8d491c54f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:27.905010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb595ab-17f2-4bd7-9da5-00d8d491c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:27.925409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-54540b28-1de5-4354-9b48-330734c74dc1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:27.926925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-54540b28-1de5-4354-9b48-330734c74dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:27.944449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-deb595ab-17f2-4bd7-9da5-00d8d491c54f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:27.947861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-deb595ab-17f2-4bd7-9da5-00d8d491c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:27.951170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 777/1545] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:27.952730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:27.953228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:27.953721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:27.974769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 769/1546] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:27.980138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116517-7f61-4b98-9b94-50a5ebc3cdd6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:27.980656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116517-7f61-4b98-9b94-50a5ebc3cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:27.981141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116517-7f61-4b98-9b94-50a5ebc3cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:27.995297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.000220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.011354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2c116517-7f61-4b98-9b94-50a5ebc3cdd6 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.014881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2c116517-7f61-4b98-9b94-50a5ebc3cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.019501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 778/1547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.020562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.035336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f877cac-e7ad-41c6-85e3-759695cbf05f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.037678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 770/1548] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.039248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.039757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.041099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.053036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.054009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.054490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.054977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.055956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.056470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.064858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.068996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.070490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.086790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 771/1550] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.091514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 779/1550] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.092919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.094482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.116735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff983-7235-4c14-a9aa-02c6ce83aa2c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.119443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73ad1b-dac7-4a71-a6be-9856ee797a60 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.128430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.129222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.130124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.131643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.132334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.132821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.133751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.134242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.134726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.135256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.136198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.138353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.140158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.140425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.166051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 780/1551] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.166633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 772/1552] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.167728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.177075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.194611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66040616-5103-4f0d-ba2b-fe697c732e2c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.195879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f5ae-0009-41a2-a1ab-ff80ed7e9031 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.205123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.205882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.206173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.206452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.207301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.209227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.210010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.210894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.211429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.211910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.213242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.215380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.272841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 781/1553] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:28.273744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.279095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 773/1554] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:28.279921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.387640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c6ca8-ad81-4b02-862a-1f7497cee79f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.436861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47f02-4312-4af2-9328-70c7b226ac51 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.446718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.447653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.447774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.447960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.448725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.450714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.475888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 774/1555] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:28.476705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.482761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed395220-0112-4308-879c-ae2423245a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.483750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395220-0112-4308-879c-ae2423245a31 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.484220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395220-0112-4308-879c-ae2423245a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.484661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395220-0112-4308-879c-ae2423245a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.485585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed395220-0112-4308-879c-ae2423245a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.486530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c24f-f5d6-450a-8d11-3cfd66207ff1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.488020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed395220-0112-4308-879c-ae2423245a31 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.491988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f974262-61a1-4c4d-9566-276c276f14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.492648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974262-61a1-4c4d-9566-276c276f14e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.493908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974262-61a1-4c4d-9566-276c276f14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.493908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974262-61a1-4c4d-9566-276c276f14e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.493908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f974262-61a1-4c4d-9566-276c276f14e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.495799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f974262-61a1-4c4d-9566-276c276f14e9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.516191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 775/1556] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:28.516693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 782/1557] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:28.517539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a0e6-aab0-4c4b-b581-8e9998f7cf99 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.518056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a0e6-aab0-4c4b-b581-8e9998f7cf99 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.518200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47214c4-5931-4832-9c20-5c1c43698160 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.518382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a0e6-aab0-4c4b-b581-8e9998f7cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.518494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47214c4-5931-4832-9c20-5c1c43698160 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.518741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47214c4-5931-4832-9c20-5c1c43698160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.538070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3b83a0e6-aab0-4c4b-b581-8e9998f7cf99 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.538298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f47214c4-5931-4832-9c20-5c1c43698160 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.539315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f47214c4-5931-4832-9c20-5c1c43698160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.539457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3b83a0e6-aab0-4c4b-b581-8e9998f7cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.595262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 776/1558] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.595476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 783/1559] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.596918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafff37-00cd-4231-81c4-bdc51c128223 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.597212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafff37-00cd-4231-81c4-bdc51c128223 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.597490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafff37-00cd-4231-81c4-bdc51c128223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.597718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.598140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.598568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.617715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.618998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.620015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-efafff37-00cd-4231-81c4-bdc51c128223 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.621195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-efafff37-00cd-4231-81c4-bdc51c128223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.626669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 777/1560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.627451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.636202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 784/1561] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.637520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.637806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.638084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.642958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc418fd-d261-4a66-8c08-a02645dfa18f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.648174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.648825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.649106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.649381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.650144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.651826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.656242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.657445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.662807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 778/1562] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:28.663801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.665815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 785/1563] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.666580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.676268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2539d-e532-4411-a43f-dd4cd75c0a2e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.677022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6809aa-9638-4251-8b66-6c5ea5903b8f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.681490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3932491-629d-4d23-b1ed-ea5154885ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.682190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3932491-629d-4d23-b1ed-ea5154885ffe admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.682318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79176a-8fb5-4495-be1a-cf1651035eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.682470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3932491-629d-4d23-b1ed-ea5154885ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.682746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3932491-629d-4d23-b1ed-ea5154885ffe admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.682951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79176a-8fb5-4495-be1a-cf1651035eca admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.683257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79176a-8fb5-4495-be1a-cf1651035eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.683488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3932491-629d-4d23-b1ed-ea5154885ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.683610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79176a-8fb5-4495-be1a-cf1651035eca admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.684302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79176a-8fb5-4495-be1a-cf1651035eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.685414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3932491-629d-4d23-b1ed-ea5154885ffe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.686023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79176a-8fb5-4495-be1a-cf1651035eca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.696214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 779/1564] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:28.697305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a608a-966a-4787-bbac-d6dc8097ceaa None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.697614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a608a-966a-4787-bbac-d6dc8097ceaa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.697899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a608a-966a-4787-bbac-d6dc8097ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.705632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 786/1565] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:28.706970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a6c5-a9e6-4ca4-b273-765ae7381c40 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.707356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a6c5-a9e6-4ca4-b273-765ae7381c40 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.707636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a6c5-a9e6-4ca4-b273-765ae7381c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.715251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-734a608a-966a-4787-bbac-d6dc8097ceaa None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.716449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-734a608a-966a-4787-bbac-d6dc8097ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.724235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 780/1566] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.728694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b873a6c5-a9e6-4ca4-b273-765ae7381c40 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.728829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.728829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.729010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b873a6c5-a9e6-4ca4-b273-765ae7381c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.729107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.736432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 787/1567] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.737677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7424208-6ad5-4c29-bce1-4fe42a38af75 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.737958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7424208-6ad5-4c29-bce1-4fe42a38af75 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.738609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7424208-6ad5-4c29-bce1-4fe42a38af75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.747514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.748720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.756540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d7424208-6ad5-4c29-bce1-4fe42a38af75 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.756684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 781/1568] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.757383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.757697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d7424208-6ad5-4c29-bce1-4fe42a38af75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.765728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 788/1569] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.766621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2b9f-2870-437c-a4f1-a3d1c0fde208 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.766938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.767259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.767539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.772154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.772817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.773092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.773362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.774097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.775712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.784577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:28.785341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 782/1570] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:28.785754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:28.786169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.795031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 789/1571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:28.795856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.796071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdac2dc-34ea-4775-8f4b-1596676cae1c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.801591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.802260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.802546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.803417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.804147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.805720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.808123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a881f-25c4-4283-9f9f-3a05d28b4d85 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.812686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.813321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.813604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.813876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.814602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.815422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 783/1572] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:28.816197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.816310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.829459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 790/1573] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:28.829459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.829724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368f704-b499-45a7-9c4f-a6ebfb26d37a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.832506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.833139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.833425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.833721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.834987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.835349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.836905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.837415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ae5b-10f9-4ed8-9784-251f0d19210c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.842039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.842654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.842934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.843259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.843980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.844311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.845872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.848824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 784/1574] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.849610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.858154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 791/1575] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.858955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.859449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ceab9-035e-4b7e-aff6-09f056318735 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.864738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.866306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.866748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.867022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.867782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.868085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.869137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35f154-2125-4c7c-9aaa-6b54f217c6dc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.869663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.873726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.874351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.874634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.874908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.875657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.875961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.877530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.881888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 785/1576] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.882658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.889738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 792/1577] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.890527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.897283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cac60-9e5e-48e1-b03b-4bcbe35da782 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.900043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165f949-ce0e-46d6-b633-6a2ded0a288f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.901885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.902743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.903082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.903333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] PATH_INFO: `/v3/projects/3978e85ac345454a9f286c57ac62f7cb/users/8a46912b0b5046f68998c63920a39de4/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.904571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.905195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.905510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.905790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.906543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:28.906847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.908462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.917762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3978e85ac345454a9f286c57ac62f7cb, user_id=8a46912b0b5046f68998c63920a39de4, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:28.920196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 793/1578] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:28.920490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:28.920955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.933912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 786/1579] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:28 2021] PUT /identity/v3/projects/3978e85ac345454a9f286c57ac62f7cb/users/8a46912b0b5046f68998c63920a39de4/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:28.934758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:28.936974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add7e9-5d22-4fb8-b682-f19a61d9b80f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:28.994312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:28.995133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:28.995415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:28.995690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] PATH_INFO: `/v3/projects/d7fdc9b85ec14982acc0d7e45db100d8/users/72a5548a03ba4cb9b0d6619d39074414/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:28.998043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4285f-3b3c-421b-a9a3-d0b624b3548b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.002751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.003481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.003763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.004037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.004763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.007019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.009933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fdc9b85ec14982acc0d7e45db100d8, user_id=72a5548a03ba4cb9b0d6619d39074414, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.012620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.016589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 787/1580] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.017714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.028201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 794/1581] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:28 2021] PUT /identity/v3/projects/d7fdc9b85ec14982acc0d7e45db100d8/users/72a5548a03ba4cb9b0d6619d39074414/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:29.028987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.029109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586616cf-300f-4e60-a839-95c1dbe562cd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.083797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.084504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.084787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.085061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.085755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.086995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed29be-5f22-489f-9c61-e25687239af8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.087670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.091618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.092260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.092556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.092813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.093500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.095459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.112229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 788/1582] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.113022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.124708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 795/1583] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.125512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.172943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a7a6-438f-4c49-97d0-4b765dfe6c9e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.184130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ffba-a630-4b8e-a60d-84d0ee62c3fa admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.188784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.189423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.189702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.189977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.190670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.192606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.218117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 796/1584] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.218912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.227640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998a5d-e8d2-4a0c-a7a3-447255863613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.228371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998a5d-e8d2-4a0c-a7a3-447255863613 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.228654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998a5d-e8d2-4a0c-a7a3-447255863613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.228927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998a5d-e8d2-4a0c-a7a3-447255863613 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.229615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b998a5d-e8d2-4a0c-a7a3-447255863613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.231555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b998a5d-e8d2-4a0c-a7a3-447255863613 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.259569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 789/1585] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.259569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.259569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.259569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.281058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c2a4f-ef22-4787-bb81-a593c043cd40 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.282968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] MFA Rules not processed for user `8a46912b0b5046f68998c63920a39de4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:29.284223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:29.335218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26de59-58ad-49aa-a20b-206552d5ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.335872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26de59-58ad-49aa-a20b-206552d5ff2b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.336155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26de59-58ad-49aa-a20b-206552d5ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.336429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26de59-58ad-49aa-a20b-206552d5ff2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.337131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26de59-58ad-49aa-a20b-206552d5ff2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.339023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26de59-58ad-49aa-a20b-206552d5ff2b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.345866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 790/1586] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:29.346638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.358817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932444-14e0-4c14-81f8-3e84a4dced0c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.363909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.364826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.365112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.366069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] PATH_INFO: `/v3/projects/09a1ffd85f2d46bb8964cfdfca6680e0/users/dd0921dd5c0643f5a36626014de145b6/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.367613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 797/1587] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.369110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.369400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.369669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.380504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a1ffd85f2d46bb8964cfdfca6680e0, user_id=dd0921dd5c0643f5a36626014de145b6, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.383204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.396326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] MFA Rules not processed for user `72a5548a03ba4cb9b0d6619d39074414`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:29.396547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 791/1588] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:29 2021] PUT /identity/v3/projects/09a1ffd85f2d46bb8964cfdfca6680e0/users/dd0921dd5c0643f5a36626014de145b6/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:29.397127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.397681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:29.456643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd9d79-7d66-4c2d-a3b0-7297e05ca17d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.461509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 798/1589] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:29.461817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.462139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.462472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.462752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.463025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.463800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.465718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.474720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d43a4-adbb-4938-bd2d-8477b874d58b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.479703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.480357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.480637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.480914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.481620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.483552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.485667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 792/1590] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.489869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.500247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e219-a36b-42f7-a7a8-27ccce44ad6a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.503117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 799/1591] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.503896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.508532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.509172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.509495 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.509820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.510426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.512361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.514616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573660-eb14-42a6-9989-d2cde5aa9368 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.519478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ea534-4c54-4a96-9586-b7fd5f779596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.520228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ea534-4c54-4a96-9586-b7fd5f779596 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.520512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ea534-4c54-4a96-9586-b7fd5f779596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.520815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ea534-4c54-4a96-9586-b7fd5f779596 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.521534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ea534-4c54-4a96-9586-b7fd5f779596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.524039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ea534-4c54-4a96-9586-b7fd5f779596 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.532375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 793/1592] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.533177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.542443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a603-cec3-4b9b-98ab-55b2e97be1e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.546448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 800/1593] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.546448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6f23-f8cb-403a-9564-83d432032e8a None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.546448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6f23-f8cb-403a-9564-83d432032e8a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.546448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6f23-f8cb-403a-9564-83d432032e8a None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.546980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 801/1594] 10.222.0.43 () {54 vars in 961 bytes} [Tue Dec 14 03:14:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:29.548059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.548314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.548591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.550293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.550942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.551256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.551535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.552251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.554132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.577444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 794/1595] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.577681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] MFA Rules not processed for user `dd0921dd5c0643f5a36626014de145b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:29.577795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.577894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:29.585095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8909bb1-e25d-4502-b956-413be9c91de9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.589861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.590609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.590964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.591273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.591960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.593848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.619613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 795/1596] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.620539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.638943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 802/1597] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:29.639803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.649674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4f60-48ab-462c-93c2-f5e79406ad73 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.683669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c6f88-9d17-4816-bd06-cd3dbe935dfa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.688178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.688834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.689118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.689391 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.690170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.691795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.702004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 796/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.704693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.705595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.705883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.705992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.706159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.706893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.708508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.715028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febce1-f562-4eb4-bb8f-9e8746383075 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.720977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 803/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.720977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.721186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80892258-c044-413e-9ad2-8e76724d61a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.721186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80892258-c044-413e-9ad2-8e76724d61a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.721186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80892258-c044-413e-9ad2-8e76724d61a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.721186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80892258-c044-413e-9ad2-8e76724d61a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.721641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80892258-c044-413e-9ad2-8e76724d61a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.723242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80892258-c044-413e-9ad2-8e76724d61a1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.728126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a270c-4dc9-41bc-8134-74a6bb5544b5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.732835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 797/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.732968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.733592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.733946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.734107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.734355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.734482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.734655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.735397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.737311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.748216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 804/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.749088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.753195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:29.754465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:29.758884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292035-79ae-4214-bb10-0ba9b0b0e05d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.763642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.764215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.764497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.764772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.765484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.767215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.776911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 805/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.777480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.786792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebf74-7475-4317-9b00-04ed2998cf89 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.791362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.791977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.792258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.792534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.793206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.795129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.816918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 806/1603] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.817922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.822098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 798/1604] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:29.822821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.830580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf51b8-9661-4fd0-85ba-a969fde6005e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.833361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c531dfa-01e1-44df-9970-d5609a54e828 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.835244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.835872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.836164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.836414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.837099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.838037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.838679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.838961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.839099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.839263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.840027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.841624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.851742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 799/1605] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.852735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.863977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b056b-3c22-4549-ba2f-9dcbe6682c7b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.868444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 807/1606] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:29 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:29.868444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.920434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.921201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.921487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.921766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.922488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.924086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.924223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053d3d-5c10-4de6-8f72-5ccf56a88417 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.928942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.929624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.929906 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.930325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.931086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.932679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.934165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 800/1607] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.935090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.946569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 808/1608] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.946569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.946859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f4f3d-ae4c-4e34-b903-027fe1c3b786 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.949536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.950326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.950613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.950885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.951757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.953348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.954002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a00d0e-7be8-436d-accd-727cedc57a20 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.958605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.959799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.960080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.960352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.961110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.962663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.963848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 801/1609] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.964626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.973089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 809/1610] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.973635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae0f4f-2dd6-46cb-995f-3f78b31dfb7b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:29.973754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:29.980496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:29.981126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:29.981407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:29.981681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:29.982397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:29.984017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:29.994294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 802/1611] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:29.995063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.003906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd092405-1049-4ee3-bcb8-3c32edcd7982 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.008903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.009727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.010004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.010276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] PATH_INFO: `/v3/projects/9ee92ea1c1534fa4b7c1d28398d8d31b/users/76e0dda1c7ad46ce80ae01b346b84ca3/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.024647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee92ea1c1534fa4b7c1d28398d8d31b, user_id=76e0dda1c7ad46ce80ae01b346b84ca3, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.027410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.040934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 803/1612] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:29 2021] PUT /identity/v3/projects/9ee92ea1c1534fa4b7c1d28398d8d31b/users/76e0dda1c7ad46ce80ae01b346b84ca3/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.041713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.043754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919af6d-ca79-468a-a6d1-a210100d52f9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.099067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2314861-0d5e-40b0-a343-42f26928bd29 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.104014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.104672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.104861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.104986 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.105215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.105494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.105770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.105909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.106039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.107843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.128239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 804/1613] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:30.129029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.138757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04ff28-5660-4c81-8fd0-c06203cfb9b9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.143388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.144235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.144517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.144794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] PATH_INFO: `/v3/projects/da53d564588b46b7bd658659f40a6ded/users/0a4d52d1d56e44fe97650262ca2e68df/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.159167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da53d564588b46b7bd658659f40a6ded, user_id=0a4d52d1d56e44fe97650262ca2e68df, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.161779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.162811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.164493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.173834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 810/1614] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:29 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:30.174345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 805/1615] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/da53d564588b46b7bd658659f40a6ded/users/0a4d52d1d56e44fe97650262ca2e68df/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.174749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.175250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.184765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378abc1-2e7f-4d0b-977d-c4209360b65a service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.236537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6aee-a603-4e2e-9987-5ea75b65462b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.241355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.241854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.242236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.242520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.242793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] PATH_INFO: `/v3/projects/bb4be946dd9b4b2080fb3b398521624e/users/57a541b5dc154896bced57a79750a3c4/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.243008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.243596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.243899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] PATH_INFO: `/v3/projects/7efcbf12d6654bc68690363892415b77/users/63a8e0684f10464394e4f935d687cc48/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.258933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efcbf12d6654bc68690363892415b77, user_id=63a8e0684f10464394e4f935d687cc48, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.259637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4be946dd9b4b2080fb3b398521624e, user_id=57a541b5dc154896bced57a79750a3c4, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.261604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.262828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.275753 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 806/1616] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/7efcbf12d6654bc68690363892415b77/users/63a8e0684f10464394e4f935d687cc48/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.276457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.277859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 811/1617] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/bb4be946dd9b4b2080fb3b398521624e/users/57a541b5dc154896bced57a79750a3c4/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.279085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.342628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43f33-2126-40a6-8f85-2aa2c0d197ce admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.345140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80445439-70ad-40fd-9782-20017d4ca6f6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.347880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ef9c7-06ca-48e2-8cc0-ce8b5ebb0cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.348829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ef9c7-06ca-48e2-8cc0-ce8b5ebb0cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.349110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ef9c7-06ca-48e2-8cc0-ce8b5ebb0cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.349381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ef9c7-06ca-48e2-8cc0-ce8b5ebb0cc6 admin admin] PATH_INFO: `/v3/projects/11634c00674445cb81d9dabfbcc791a8/users/107444106cda461dab7c403665d92613/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.350435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.351443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.351852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.352214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] PATH_INFO: `/v3/projects/3af55fe172424f0697f23b6098078253/users/2930747f3a2f4d729bea43b2ab8833d6/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.366380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ef9c7-06ca-48e2-8cc0-ce8b5ebb0cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11634c00674445cb81d9dabfbcc791a8, user_id=107444106cda461dab7c403665d92613, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.367581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af55fe172424f0697f23b6098078253, user_id=2930747f3a2f4d729bea43b2ab8833d6, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.369223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ef9c7-06ca-48e2-8cc0-ce8b5ebb0cc6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.370445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.383617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 807/1618] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/11634c00674445cb81d9dabfbcc791a8/users/107444106cda461dab7c403665d92613/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.384874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb45c78-12d6-45b9-a362-50923b5d341a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.385161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb45c78-12d6-45b9-a362-50923b5d341a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.385566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb45c78-12d6-45b9-a362-50923b5d341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.391136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 812/1619] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/3af55fe172424f0697f23b6098078253/users/2930747f3a2f4d729bea43b2ab8833d6/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.391136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.415641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2eb45c78-12d6-45b9-a362-50923b5d341a None None] MFA Rules not processed for user `76e0dda1c7ad46ce80ae01b346b84ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:30.416837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2eb45c78-12d6-45b9-a362-50923b5d341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:30.450875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e9195-3763-445a-a347-4e9f5cbad201 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.455876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916466c-e049-4ec0-9285-1b081e01baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.456537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916466c-e049-4ec0-9285-1b081e01baf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.456815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916466c-e049-4ec0-9285-1b081e01baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.457112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916466c-e049-4ec0-9285-1b081e01baf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.457840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916466c-e049-4ec0-9285-1b081e01baf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.459672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916466c-e049-4ec0-9285-1b081e01baf8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.469202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 813/1620] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:30.473665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216df32-6fef-4817-a5d9-f992d914ff0c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.473954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216df32-6fef-4817-a5d9-f992d914ff0c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.474229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216df32-6fef-4817-a5d9-f992d914ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.479966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 808/1621] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:30.481349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0a2e-e6b7-4c8b-9c97-973c7cd3e21e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.481534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0a2e-e6b7-4c8b-9c97-973c7cd3e21e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.481807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0a2e-e6b7-4c8b-9c97-973c7cd3e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.491996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5216df32-6fef-4817-a5d9-f992d914ff0c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:30.493189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5216df32-6fef-4817-a5d9-f992d914ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:30.499883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0cac0a2e-e6b7-4c8b-9c97-973c7cd3e21e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:30.500607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 814/1622] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:30.501041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0cac0a2e-e6b7-4c8b-9c97-973c7cd3e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:30.501809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.502092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.502364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.512627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 809/1623] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:30.514003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9cb6-33fb-4fcd-9e4a-e1d23d8dbcdd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.514289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9cb6-33fb-4fcd-9e4a-e1d23d8dbcdd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.514561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9cb6-33fb-4fcd-9e4a-e1d23d8dbcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.519873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:30.521041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:30.528915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 815/1624] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:30.529466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.531771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-587c9cb6-33fb-4fcd-9e4a-e1d23d8dbcdd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:30.532946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-587c9cb6-33fb-4fcd-9e4a-e1d23d8dbcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:30.538569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4032742-2836-4efc-861c-f11f260d4317 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.540745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 810/1625] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:30.542077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f7a2e-bd40-48c2-ab96-09218743e468 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.542365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f7a2e-bd40-48c2-ab96-09218743e468 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.542638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f7a2e-bd40-48c2-ab96-09218743e468 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.543415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.544052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.544331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.544702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 811/1626] 10.222.0.43 () {54 vars in 912 bytes} [Tue Dec 14 03:14:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:30.545342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f7a2e-bd40-48c2-ab96-09218743e468 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.548775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.549558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.551174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.558482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f7a2e-bd40-48c2-ab96-09218743e468 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.561713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 816/1627] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:30.562551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.565216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.566178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.566395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.566768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] PATH_INFO: `/v3/projects/c22a29cbd3d44acba66774b6372ac2c7/users/1fa8d15598d147f68dec80b26cb255a6/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.581344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22a29cbd3d44acba66774b6372ac2c7, user_id=1fa8d15598d147f68dec80b26cb255a6, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.584018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.597741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 812/1628] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/c22a29cbd3d44acba66774b6372ac2c7/users/1fa8d15598d147f68dec80b26cb255a6/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.598519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.616644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3cbe7-b3cc-4d85-b3cb-7dde80f6677a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.650589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4d298-eb8e-4a04-8926-8038ddd28f21 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.654209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.654846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.655159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.655436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.667024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.667689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.667973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.668246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.713332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.714765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.721803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.723454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.724169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 813/1629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:30.725502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.732793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 817/1630] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:30.733338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13597b8d-d2a3-4821-97a3-1dcc9bfca7ec service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.733600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.738787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.739897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.739897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.740262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.742839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2d0d0-d8a5-4889-ad68-1b354dfd5e65 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.746862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c4f5-34d1-4cb9-8c99-3100908bd1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.747591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c4f5-34d1-4cb9-8c99-3100908bd1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.747938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c4f5-34d1-4cb9-8c99-3100908bd1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.748277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c4f5-34d1-4cb9-8c99-3100908bd1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.750502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.752047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.758853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c4f5-34d1-4cb9-8c99-3100908bd1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.760514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c4f5-34d1-4cb9-8c99-3100908bd1a6 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.771788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 818/1631] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:30.773058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.773525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.773895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.780975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 814/1632] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:30.781926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.796642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:30.798812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:30.805541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898721b-120d-4880-9df0-1138829c9a43 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.815614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.816312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.816594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.817531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.843707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.848508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.874278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 815/1633] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:30.875196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.897692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c1d89-c8e9-4bb2-9479-a4cd787d6f6b service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.900322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 819/1634] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:14:30 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:30.902420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.910720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.914729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.915719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.916160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] PATH_INFO: `/v3/projects/3af55fe172424f0697f23b6098078253/users/2930747f3a2f4d729bea43b2ab8833d6/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.918588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6f76a-2405-40e7-8309-28b80416e033 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.921319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af55fe172424f0697f23b6098078253, user_id=2930747f3a2f4d729bea43b2ab8833d6, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.924767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:30.925652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:30.926180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:30.926553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:30.927558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:30.930047 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.931145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:30.942118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 820/1635] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:30.946296 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:30.957353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea671-8058-4fea-bf05-3b7b1f690260 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:30.969660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 816/1636] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/3af55fe172424f0697f23b6098078253/users/2930747f3a2f4d729bea43b2ab8833d6/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:30.969660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:31.025363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b576860-a729-4226-a26a-e14e017d53f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:31.026198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576860-a729-4226-a26a-e14e017d53f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:31.026854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576860-a729-4226-a26a-e14e017d53f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:31.026992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576860-a729-4226-a26a-e14e017d53f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:31.097381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d503c9e-f0a2-4952-a34e-1251c6928431 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:31.110761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee0da1-d88a-4b71-b14f-d07f52e21af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:31.111437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee0da1-d88a-4b71-b14f-d07f52e21af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:31.111861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee0da1-d88a-4b71-b14f-d07f52e21af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:31.112141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee0da1-d88a-4b71-b14f-d07f52e21af6 admin admin] PATH_INFO: `/v3/projects/c22a29cbd3d44acba66774b6372ac2c7/users/1fa8d15598d147f68dec80b26cb255a6/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:31.114682 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee0da1-d88a-4b71-b14f-d07f52e21af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22a29cbd3d44acba66774b6372ac2c7, user_id=1fa8d15598d147f68dec80b26cb255a6, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:31.116421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b576860-a729-4226-a26a-e14e017d53f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:31.118008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b576860-a729-4226-a26a-e14e017d53f2 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:31.118147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee0da1-d88a-4b71-b14f-d07f52e21af6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:31.130314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 817/1637] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:30 2021] PUT /identity/v3/projects/c22a29cbd3d44acba66774b6372ac2c7/users/1fa8d15598d147f68dec80b26cb255a6/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:31.132452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:31.132734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:31.133009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:31.136462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 821/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:31.141387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:31.141751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:31.142242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:31.202138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] MFA Rules not processed for user `2930747f3a2f4d729bea43b2ab8833d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:31.202138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:31.210370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] MFA Rules not processed for user `1fa8d15598d147f68dec80b26cb255a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:31.215336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:31.323222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 818/1639] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:31 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:31.363605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 822/1640] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:31 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:31.689243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:31.894219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e1aa-e6be-4d10-84bd-baeacf891776 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:31.915579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:31.916238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:31.916519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:31.916805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:31.944097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:31.947311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:31.969430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 819/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:31 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:32.020155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:32.034002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94404a7-7db1-46b0-ab97-7f40b2695622 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:32.038109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:32.039391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.039824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.045371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.068008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:32.070575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:32.097980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 823/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:32 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:32.144963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:32.145721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:32.179774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e688b-0db9-464e-9f03-8f314c561c6a service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:32.200990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158193b-7bad-4b0b-976f-3238f793fcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:32.201529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158193b-7bad-4b0b-976f-3238f793fcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.201808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158193b-7bad-4b0b-976f-3238f793fcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.202354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158193b-7bad-4b0b-976f-3238f793fcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.310075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158193b-7bad-4b0b-976f-3238f793fcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:32.310650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fc8ca-5fa5-461e-9d27-623e8001a416 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:32.312239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158193b-7bad-4b0b-976f-3238f793fcf4 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:32.318165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:32.319360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.319833 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.320295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] PATH_INFO: `/v3/users/dd0921dd5c0643f5a36626014de145b6` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.321707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0921dd5c0643f5a36626014de145b6)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:32.323592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 820/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:32 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:32.324814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:32.418999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0921dd5c0643f5a36626014de145b6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:32.420607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0921dd5c0643f5a36626014de145b6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:32.445498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0921dd5c0643f5a36626014de145b6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:32.447344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0921dd5c0643f5a36626014de145b6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:32.471256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-16cf521f-0cfc-4b4f-8e1a-e40345f611fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0921dd5c0643f5a36626014de145b6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:32.493895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 824/1644] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:32 2021] DELETE /identity/v3/users/dd0921dd5c0643f5a36626014de145b6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:32.499469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.502020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.502610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.535982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:32.537435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:32.681894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 821/1645] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:32.716932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d856f74-0c8e-48e0-9184-70e851e38eb1 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.717517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d856f74-0c8e-48e0-9184-70e851e38eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.717983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d856f74-0c8e-48e0-9184-70e851e38eb1 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.718882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:32.720775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 825/1646] 10.222.0.43 () {54 vars in 961 bytes} [Tue Dec 14 03:14:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:32.721325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:32.734967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653cf7e-1330-4f44-9b6c-845067b452f4 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.735411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653cf7e-1330-4f44-9b6c-845067b452f4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.735851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653cf7e-1330-4f44-9b6c-845067b452f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.768203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1653cf7e-1330-4f44-9b6c-845067b452f4 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:32.779750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1653cf7e-1330-4f44-9b6c-845067b452f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:32.862642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1948-8a2f-4288-9876-a75bf8b8abbd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:32.874541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa4dd-de87-469e-843d-24bd252b07f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:32.874991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa4dd-de87-469e-843d-24bd252b07f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.875305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa4dd-de87-469e-843d-24bd252b07f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.875585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa4dd-de87-469e-843d-24bd252b07f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.907539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fa4dd-de87-469e-843d-24bd252b07f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:32.908861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fa4dd-de87-469e-843d-24bd252b07f1 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:32.933236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 822/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:14:32.949591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 826/1648] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Dec 14 03:14:32 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:32.958166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822368-5188-4a37-9a52-da4d9f5c98f6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.958166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822368-5188-4a37-9a52-da4d9f5c98f6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.958166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822368-5188-4a37-9a52-da4d9f5c98f6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:32.959067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 823/1649] 10.222.0.43 () {54 vars in 912 bytes} [Tue Dec 14 03:14:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:32.973181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:32.973900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:32.974926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:33.004272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:33.006107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:33.020894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 827/1650] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:14:32 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:33.042189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5204a9-33bb-489a-8237-d3cf36652753 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:33.042478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5204a9-33bb-489a-8237-d3cf36652753 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:33.042779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5204a9-33bb-489a-8237-d3cf36652753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:33.056670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:33.058579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:33.098941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fc5204a9-33bb-489a-8237-d3cf36652753 None None] MFA Rules not processed for user `63a8e0684f10464394e4f935d687cc48`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:33.100899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fc5204a9-33bb-489a-8237-d3cf36652753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:33.199489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7318-ccbf-4dd6-a031-64efaab2c377 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:33.210207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:33.211649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:33.211649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:33.211649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:33.233643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:33.235167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:33.262902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 824/1651] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:33 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:33.264692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8be02-2d70-4204-a777-51331aa16a9a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:33.265156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8be02-2d70-4204-a777-51331aa16a9a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:33.265609 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8be02-2d70-4204-a777-51331aa16a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:33.268421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 828/1652] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:33.288595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c2e8be02-2d70-4204-a777-51331aa16a9a None None] MFA Rules not processed for user `63a8e0684f10464394e4f935d687cc48`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:33.290248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c2e8be02-2d70-4204-a777-51331aa16a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:33.321712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 825/1653] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:33 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:33.333702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:33.335673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:33.359106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e4e8-77a4-4b1b-bf44-a38826bd116a service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:33.377252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5e6f-3397-426e-a47e-88801fe3fd15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:33.379465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5e6f-3397-426e-a47e-88801fe3fd15 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:33.379977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5e6f-3397-426e-a47e-88801fe3fd15 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:33.380513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5e6f-3397-426e-a47e-88801fe3fd15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:33.393624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5e6f-3397-426e-a47e-88801fe3fd15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:33.395847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5e6f-3397-426e-a47e-88801fe3fd15 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:33.408308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 829/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:33 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:34.109671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f2b8-cba1-4c96-83e6-9fc9028409f9 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:34.110597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f2b8-cba1-4c96-83e6-9fc9028409f9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:34.110948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f2b8-cba1-4c96-83e6-9fc9028409f9 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:34.113528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 826/1655] 10.222.0.43 () {54 vars in 912 bytes} [Tue Dec 14 03:14:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:34.121311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:34.122321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:34.122912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:34.186601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] MFA Rules not processed for user `5f08db48e9814f7db34ffcf7d581fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:34.189086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:34.215343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 830/1656] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:14:34 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:34.239392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f2b8-cba1-4c96-83e6-9fc9028409f9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:34.242907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7bd7f2b8-cba1-4c96-83e6-9fc9028409f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:34.274794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f2b8-cba1-4c96-83e6-9fc9028409f9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:34.284875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:34.288158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:34.288599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:34.290633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:34.310498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:34.314164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:34.326073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 827/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:34.636587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:34.638668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:34.670121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9bdd1-79b7-446e-b7e8-1dd5835a914c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:34.681440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:34.682317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:34.682602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:34.682878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] PATH_INFO: `/v3/projects/09a1ffd85f2d46bb8964cfdfca6680e0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:34.684348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a1ffd85f2d46bb8964cfdfca6680e0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:34.685598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: WARNING py.warnings [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:14:34.685598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: warnings.warn(msg) Dec 14 03:14:34.685598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: Dec 14 03:14:34.690424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:34.837011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a1ffd85f2d46bb8964cfdfca6680e0', 'request_id': 'req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:34.888132 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a1ffd85f2d46bb8964cfdfca6680e0', 'request_id': 'req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:34.903629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a1ffd85f2d46bb8964cfdfca6680e0', 'request_id': 'req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:34.924348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] The token cache is being invalidate because project 09a1ffd85f2d46bb8964cfdfca6680e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:34.924650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:34.925359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:34.927236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 831/1658] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:34 2021] DELETE /identity/v3/projects/09a1ffd85f2d46bb8964cfdfca6680e0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:34.932736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:34.951305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08e452-54fc-4544-b931-a5f400bb93a1 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:35.059187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:35.061089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:35.063380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:35.064009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] PATH_INFO: `/v3/users/1fa8d15598d147f68dec80b26cb255a6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:35.066520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa8d15598d147f68dec80b26cb255a6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:35.068540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:14:35.068540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Dec 14 03:14:35.068540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: Dec 14 03:14:35.077626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:35.214598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa8d15598d147f68dec80b26cb255a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:35.240650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa8d15598d147f68dec80b26cb255a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:35.242046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa8d15598d147f68dec80b26cb255a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:35.287151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa8d15598d147f68dec80b26cb255a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:35.298861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa8d15598d147f68dec80b26cb255a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:35.307091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 828/1659] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:34 2021] DELETE /identity/v3/users/1fa8d15598d147f68dec80b26cb255a6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:35.537809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:35.540091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:35.715916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62ff6-f64d-45f1-a4ad-7bcbb78665fd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:35.827028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:35.827526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:35.827903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:35.828245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:35.831931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:35.855101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:35.861437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:35.876263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 832/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:36.361428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:36.363880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:36.418428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:36.420107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:36.588539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c89bc-1b46-4f0c-8044-d00aaa5c46bb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:36.608846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:36.610819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:36.612390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:36.612896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] PATH_INFO: `/v3/users/8a46912b0b5046f68998c63920a39de4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:36.625668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fbc5a-78e3-4951-9b23-6aab002e1f95 service placement] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:36.626244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a46912b0b5046f68998c63920a39de4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:36.630421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:36.637630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:36.638901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:36.656122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:36.656983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] PATH_INFO: `/v3/projects/c22a29cbd3d44acba66774b6372ac2c7` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:36.659479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22a29cbd3d44acba66774b6372ac2c7)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:36.661800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:36.824541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22a29cbd3d44acba66774b6372ac2c7', 'request_id': 'req-b4e59904-9f9b-4692-8edf-30d5f79c5892'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.825313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a46912b0b5046f68998c63920a39de4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.837576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a46912b0b5046f68998c63920a39de4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.838954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a46912b0b5046f68998c63920a39de4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.841233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22a29cbd3d44acba66774b6372ac2c7', 'request_id': 'req-b4e59904-9f9b-4692-8edf-30d5f79c5892'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.868655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22a29cbd3d44acba66774b6372ac2c7', 'request_id': 'req-b4e59904-9f9b-4692-8edf-30d5f79c5892'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.900360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] The token cache is being invalidate because project c22a29cbd3d44acba66774b6372ac2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:36.900637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.906649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b4e59904-9f9b-4692-8edf-30d5f79c5892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.914971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 833/1661] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:36 2021] DELETE /identity/v3/projects/c22a29cbd3d44acba66774b6372ac2c7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:36.920927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9cc3-9aca-4e88-9293-cd2ec4425b6f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:36.921164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a46912b0b5046f68998c63920a39de4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.921615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9cc3-9aca-4e88-9293-cd2ec4425b6f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:36.922051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9cc3-9aca-4e88-9293-cd2ec4425b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:36.954223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ec52b6b2-9e0d-4a47-9161-2e4f5902d31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a46912b0b5046f68998c63920a39de4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:36.977186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 829/1662] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:36 2021] DELETE /identity/v3/users/8a46912b0b5046f68998c63920a39de4 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:36.979653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a05f9cc3-9aca-4e88-9293-cd2ec4425b6f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:36.983096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:36.983640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:36.984245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a05f9cc3-9aca-4e88-9293-cd2ec4425b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:36.985014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.058174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:37.059447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:37.193698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 834/1663] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:37.212219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:37.215074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:37.215971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.324520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:37.327651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:37.329836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 830/1664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:37.359229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 835/1665] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:37.360710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:37.380347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9717f-7b76-4238-bfc3-16ec9f6453d1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:37.393236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:37.394498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:37.395845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:37.396485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.397914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:37.398559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:37.401499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:37.420790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:37.422611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:37.455532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 831/1666] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:37.456771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:37.462463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:37.491955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33974493-650f-485a-90aa-e49912b41aad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:37.516181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:37.519432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:37.527646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:37.528193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] PATH_INFO: `/v3/users/72a5548a03ba4cb9b0d6619d39074414` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.532028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a5548a03ba4cb9b0d6619d39074414)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:37.541564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:37.584865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74462d4-52c2-4d20-806e-456f1c5e3c3b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:37.612995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:37.618705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:37.622755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:37.623232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.667144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:37.671290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:37.718951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a5548a03ba4cb9b0d6619d39074414'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:37.720200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 836/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:37.721638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:37.744225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a5548a03ba4cb9b0d6619d39074414'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:37.747960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a5548a03ba4cb9b0d6619d39074414'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:37.758477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6144d9-c6bf-4b30-b71e-a99321b39ff9 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:37.774271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:37.776243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:37.776726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:37.777404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.779796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:37.790554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:37.791765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a5548a03ba4cb9b0d6619d39074414'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:37.836341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f4aa04df-1f6e-400a-b9af-a73687874671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a5548a03ba4cb9b0d6619d39074414'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:37.851419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 832/1668] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:37 2021] DELETE /identity/v3/users/72a5548a03ba4cb9b0d6619d39074414 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:37.855633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:37.855929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:37.856361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:37.864680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 837/1669] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:37 2021] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:37.881502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:37.882868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:37.926209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:37.928775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:38.003339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 833/1670] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:38.074411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d3a31-90bf-43fc-8b4e-bf65b0a1946b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:38.090061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:38.090673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:38.090964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:38.091288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:38.092149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:38.094120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:38.154927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 838/1671] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:37 2021] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:14:38.155739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:38.173561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9165cb-53c0-4781-8882-db13a5bafc21 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:38.189149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:38.190001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:38.192371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:38.193633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:38.195848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:38.199464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:38.249021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 834/1672] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:14:38.253219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:38.266444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e530fc-15c3-4f7c-88e4-2b8c84470e8e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:38.300021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:38.300698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:38.300981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:38.301262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:38.302105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:38.316078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:38.368211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:38.370081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 839/1673] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:38.395338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f6551-7c37-49bc-8133-44edabbeee84 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:38.425737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54798ce0-2efd-4acf-a234-7459387e6e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:38.431914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54798ce0-2efd-4acf-a234-7459387e6e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:38.434306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54798ce0-2efd-4acf-a234-7459387e6e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:38.434687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54798ce0-2efd-4acf-a234-7459387e6e4a admin admin] PATH_INFO: `/v3/projects/241f70f0c752454fad3f39dcca6f9bc3/users/0ee69c549caa4a7585c89eaf631872cb/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:38.459973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:38.461688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:38.489508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54798ce0-2efd-4acf-a234-7459387e6e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=241f70f0c752454fad3f39dcca6f9bc3, user_id=0ee69c549caa4a7585c89eaf631872cb, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:38.492380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54798ce0-2efd-4acf-a234-7459387e6e4a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:38.529860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 835/1674] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:38 2021] PUT /identity/v3/projects/241f70f0c752454fad3f39dcca6f9bc3/users/0ee69c549caa4a7585c89eaf631872cb/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:14:38.539873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:38.540479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:38.541130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:38.632710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] MFA Rules not processed for user `0ee69c549caa4a7585c89eaf631872cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:38.640372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:38.668459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b22e-503c-4d92-b472-2082344a5d41 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:38.829594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 836/1675] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:38 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:38.830573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:38.837590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:38.838193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:38.838509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:38.839468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:38.990478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:38.994517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:39.023161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 840/1676] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:39.030963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cf0d2-3597-4fd4-9b22-a625a8322c5f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:39.047637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:39.049517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.049947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.050212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.050841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:39.057699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:39.145298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 837/1677] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:38 2021] POST /identity/v3/projects => generated 379 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:39.150363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:39.165125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ac0b7-d271-4465-9761-c81c48d72e6f service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:39.341129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:39.342190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.342779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.343268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.344261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:39.346809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:39.373340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 841/1678] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:39 2021] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:39.377087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:39.394504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51279e-ca82-4ddf-96e7-84976e159935 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:39.411141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:39.411886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.412100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.412386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.417137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:39.421874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:39.462482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 838/1679] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:39.466573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:39.477765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf18a5c-3a00-4198-b9e0-dc225654076a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:39.484380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5d58-1cc2-43ad-a044-916f61ed74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:39.485378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5d58-1cc2-43ad-a044-916f61ed74e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.485926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5d58-1cc2-43ad-a044-916f61ed74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.486581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5d58-1cc2-43ad-a044-916f61ed74e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.487605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5d58-1cc2-43ad-a044-916f61ed74e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:39.490615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5d58-1cc2-43ad-a044-916f61ed74e0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:39.502564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 842/1680] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:39.507092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:39.519969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7490-78d5-421c-9c20-97e207b53a86 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:39.531447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:39.532586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.535422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.538800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] PATH_INFO: `/v3/projects/cc9f0af4793a478ba83ea3502eb102c7/users/ca44d6ebedae42159da8a7f0f003ee50/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.591018 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9f0af4793a478ba83ea3502eb102c7, user_id=ca44d6ebedae42159da8a7f0f003ee50, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:39.595602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:39.631370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 839/1681] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:39 2021] PUT /identity/v3/projects/cc9f0af4793a478ba83ea3502eb102c7/users/ca44d6ebedae42159da8a7f0f003ee50/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:39.642314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.643117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.643668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.718241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] MFA Rules not processed for user `ca44d6ebedae42159da8a7f0f003ee50`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:39.725732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:39.825873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 843/1682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:39.830223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:39.949255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48864-cb65-4ccb-9d32-96ea1c995f97 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:39.954732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733c0b-d29f-4837-9d99-f0dc3c0b61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:39.955776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733c0b-d29f-4837-9d99-f0dc3c0b61eb admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:39.956808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733c0b-d29f-4837-9d99-f0dc3c0b61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:39.957396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733c0b-d29f-4837-9d99-f0dc3c0b61eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:39.958250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e733c0b-d29f-4837-9d99-f0dc3c0b61eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:39.960985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e733c0b-d29f-4837-9d99-f0dc3c0b61eb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:40.030588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 840/1683] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:39 2021] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:40.035254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.069896 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688a06-6ddf-4956-87a9-0156ef8c8894 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:40.144906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:40.145394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:40.145828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:40.174695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:40.177612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:40.224992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:40.226539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:40.229569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:40.230017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:40.230749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:40.234528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:40.316387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 841/1684] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:14:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 14 03:14:40.321620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 844/1685] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:40 2021] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:40.327963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.352017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f997ad-0f8e-4b4b-9e5a-5a52a3fcccc3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:40.365974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:40.366710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:40.366996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:40.367309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:40.368427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:40.370071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:40.401449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 842/1686] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:40.406002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.426659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee511b-52f7-4aeb-bb92-f057436f8b50 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:40.438002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:40.438778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:40.439137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:40.439432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] PATH_INFO: `/v3/projects/a550c996fab444e09c88fd4e8f79e423/users/943889a0d569437484425554150dfa1a/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:40.500497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a550c996fab444e09c88fd4e8f79e423, user_id=943889a0d569437484425554150dfa1a, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:40.503577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:40.557969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 845/1687] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:40 2021] PUT /identity/v3/projects/a550c996fab444e09c88fd4e8f79e423/users/943889a0d569437484425554150dfa1a/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:40.560742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.585886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586a3d1-cf4d-439e-acec-37ba9c23889a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:40.708422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.711251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:40.724855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:40.726646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:40.726987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:40.727430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:40.728206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:40.729889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:40.753033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 843/1688] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:40.779916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.822272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a676c-a2a9-4bc0-8ec8-b91f4c5927d7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:40.847945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:40.852582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:40.853473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:40.853766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] PATH_INFO: `/v3/projects/a550c996fab444e09c88fd4e8f79e423/users/943889a0d569437484425554150dfa1a/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:40.859695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a550c996fab444e09c88fd4e8f79e423, user_id=943889a0d569437484425554150dfa1a, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:40.868053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:40.904416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 844/1689] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:40 2021] PUT /identity/v3/projects/a550c996fab444e09c88fd4e8f79e423/users/943889a0d569437484425554150dfa1a/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:40.934820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:40.936345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18056ebf-f2c7-4762-ae6a-fe331e48c916 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:40.938136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:41.078981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266432bf-7d1e-42e7-9f58-df9a6020c088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:41.080668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266432bf-7d1e-42e7-9f58-df9a6020c088 service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.080955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266432bf-7d1e-42e7-9f58-df9a6020c088 service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.082471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266432bf-7d1e-42e7-9f58-df9a6020c088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.127488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f68a-907d-4f10-b6ea-7f51b69f89a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:41.137358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:41.138991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.140950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.141557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] PATH_INFO: `/v3/projects/3978e85ac345454a9f286c57ac62f7cb` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.145788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3978e85ac345454a9f286c57ac62f7cb)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:41.150911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:41.235430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266432bf-7d1e-42e7-9f58-df9a6020c088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:41.241680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266432bf-7d1e-42e7-9f58-df9a6020c088 service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:41.249481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3978e85ac345454a9f286c57ac62f7cb', 'request_id': 'req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:41.257692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3978e85ac345454a9f286c57ac62f7cb', 'request_id': 'req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:41.266998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 846/1690] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:14:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:14:41.270428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.270811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.271225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.271362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3978e85ac345454a9f286c57ac62f7cb', 'request_id': 'req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:41.294546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] The token cache is being invalidate because project 3978e85ac345454a9f286c57ac62f7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:41.295126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:41.296310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc01beb8-9c93-4ee4-9d34-5bd5c5c683ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:41.304960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 845/1691] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:40 2021] DELETE /identity/v3/projects/3978e85ac345454a9f286c57ac62f7cb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:41.306720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542581a8-a99e-456f-bd75-f7e37a5ccdce None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.307110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542581a8-a99e-456f-bd75-f7e37a5ccdce None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.307470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542581a8-a99e-456f-bd75-f7e37a5ccdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.332327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-542581a8-a99e-456f-bd75-f7e37a5ccdce None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:41.334162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-542581a8-a99e-456f-bd75-f7e37a5ccdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:41.391474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] MFA Rules not processed for user `943889a0d569437484425554150dfa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:41.397847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:41.420558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 846/1692] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:41.422091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.422678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.422909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.448511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:41.450078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:41.461945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 847/1693] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:41.467019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:41.479142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9872c2-a1ae-4cab-be66-2b2901c1a702 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:41.484689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:41.485649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.486524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.487335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.488664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:41.489165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:41.491324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:41.510835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 848/1694] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:41.512102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:41.548346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637caa7-b5d4-4d12-8f8e-ff96372b0617 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:41.566672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:41.570914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:41.574463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:41.574845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:41.580082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:41.582131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:41.702059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 849/1695] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:41 2021] POST /identity/v3/projects => generated 355 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:41.704271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:41.729590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 847/1696] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:41 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:41.734382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:41.735947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:41.962988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094ae7-90fc-41b0-935f-d7318254d096 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:42.076098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea485e22-38c0-45f7-b6fa-1879245799ee admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:42.103443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:42.104130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:42.104418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:42.104728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:42.105395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:42.107394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:42.139327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:42.139912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:42.140191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:42.140469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:42.157464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 850/1697] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:41 2021] POST /identity/v3/users => generated 278 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:42.164133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:42.171471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:42.213461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10a203-4366-4e62-aeca-66d9d1ac7a0d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:42.236630 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:42.237295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:42.237580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:42.237861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] PATH_INFO: `/v3/projects/d7fdc9b85ec14982acc0d7e45db100d8` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:42.244316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fdc9b85ec14982acc0d7e45db100d8)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:42.250314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:42.367811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:42.374335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:42.399855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fdc9b85ec14982acc0d7e45db100d8', 'request_id': 'req-ad4095f2-7a4b-411e-824f-b092e4a3ba53'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.419376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 848/1698] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:41 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:42.420685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:42.437241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fdc9b85ec14982acc0d7e45db100d8', 'request_id': 'req-ad4095f2-7a4b-411e-824f-b092e4a3ba53'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.466934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fdc9b85ec14982acc0d7e45db100d8', 'request_id': 'req-ad4095f2-7a4b-411e-824f-b092e4a3ba53'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.468641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ab60-c8b6-4faa-a0d3-730549291fbb service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:42.497848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] The token cache is being invalidate because project d7fdc9b85ec14982acc0d7e45db100d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:42.499152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.500108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.509158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 851/1699] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:42 2021] DELETE /identity/v3/projects/d7fdc9b85ec14982acc0d7e45db100d8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:42.510309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:42.517290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:42.603165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:42.604008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:42.604379 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:42.604754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:42.608108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:42.610450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:42.628278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 849/1700] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:42 2021] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:42.629975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:42.633530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:42.660760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d3f0-a660-4e2b-b4b4-ca62f4e7ce87 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:42.667579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:42.668783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:42.669270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:42.669755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] PATH_INFO: `/v3/users/2930747f3a2f4d729bea43b2ab8833d6` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:42.671292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2930747f3a2f4d729bea43b2ab8833d6)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:42.673475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:42.696355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4095f2-7a4b-411e-824f-b092e4a3ba53 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:42.705550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:42.710642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:42.712070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:42.712819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:42.721129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:42.770104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2930747f3a2f4d729bea43b2ab8833d6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.772652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2930747f3a2f4d729bea43b2ab8833d6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.803864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2930747f3a2f4d729bea43b2ab8833d6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.805553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2930747f3a2f4d729bea43b2ab8833d6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.827937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2930747f3a2f4d729bea43b2ab8833d6'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:42.870425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 850/1701] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:42 2021] DELETE /identity/v3/users/2930747f3a2f4d729bea43b2ab8833d6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:42.872345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:42.888936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:42.919412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:42.925890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:42.964890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 852/1702] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:42 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:43.113843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f1f6-cae2-47cc-b61f-2249235688a9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:43.120862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ecae-b0b5-4179-9d1f-9b6c4be173c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:43.121683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ecae-b0b5-4179-9d1f-9b6c4be173c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:43.121972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ecae-b0b5-4179-9d1f-9b6c4be173c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:43.122491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ecae-b0b5-4179-9d1f-9b6c4be173c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:43.123228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ecae-b0b5-4179-9d1f-9b6c4be173c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:43.124839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ecae-b0b5-4179-9d1f-9b6c4be173c5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:43.154526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 851/1703] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:42 2021] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:43.158493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:43.160116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:43.204248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606fc41-bfd3-48de-ade4-10d66c9c0ce9 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:43.221580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:43.222787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:43.223077 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:43.223561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] PATH_INFO: `/v3/projects/28dd72787d9244a9af4e958909347b5c/users/ced4757619774002be4e6b3e6ec8736b/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:43.290210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dd72787d9244a9af4e958909347b5c, user_id=ced4757619774002be4e6b3e6ec8736b, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:43.302264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:43.343342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 853/1704] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:43 2021] PUT /identity/v3/projects/28dd72787d9244a9af4e958909347b5c/users/ced4757619774002be4e6b3e6ec8736b/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:43.358575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:43.358854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:43.360109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:43.480674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] MFA Rules not processed for user `ced4757619774002be4e6b3e6ec8736b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:43.490812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:43.809048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 852/1705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:43 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:43.822663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.043349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307e75-d570-4bad-a4bb-b72a14792c32 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.049803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.050245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.054941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.055158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.055909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.057897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.116610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 854/1706] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:43 2021] POST /identity/v3/projects => generated 357 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:44.121139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.137987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788c4f6-0d86-4c57-a495-4026cf18e441 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.267805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.268496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.268780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.269053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.269775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.271795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.315971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 853/1707] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:44 2021] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:44.318016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.344874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0b9e0-1c4a-4275-97f5-e60ea62cfeee admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.364203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.368779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.370843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.371286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.375881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.380868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.418493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 855/1708] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:44.423547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.440103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb78a96-3b4a-4909-ba6b-2406781feea8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.452001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.453170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.453929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.455631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] PATH_INFO: `/v3/projects/d6d9f7a3ebd14c04906ac8a38ec42975/users/1010f395a1f248d7ba75fce266ec6226/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.478284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d9f7a3ebd14c04906ac8a38ec42975, user_id=1010f395a1f248d7ba75fce266ec6226, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.481372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.516015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 854/1709] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:44 2021] PUT /identity/v3/projects/d6d9f7a3ebd14c04906ac8a38ec42975/users/1010f395a1f248d7ba75fce266ec6226/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:44.516801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.532807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f38b51-f053-4edc-b499-9c969cbaf469 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.580874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.584225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:44.729336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.733596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.734441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.736827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.744971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.753567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.769714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544fcab-4c20-45c8-993e-db6765181c9a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.780786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.781987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.782574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.783222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] PATH_INFO: `/v3/users/76e0dda1c7ad46ce80ae01b346b84ca3` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.785236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e0dda1c7ad46ce80ae01b346b84ca3)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.787648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.805382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 856/1710] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:44.808278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:44.844990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467ce4-8d0d-4e06-b8ac-aab61e26df3e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:44.863694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8a0d-83e6-40e1-989c-d85bfa73b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:44.866053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8a0d-83e6-40e1-989c-d85bfa73b1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.867594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8a0d-83e6-40e1-989c-d85bfa73b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.868412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8a0d-83e6-40e1-989c-d85bfa73b1b3 admin admin] PATH_INFO: `/v3/projects/d6d9f7a3ebd14c04906ac8a38ec42975/users/1010f395a1f248d7ba75fce266ec6226/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.875525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8a0d-83e6-40e1-989c-d85bfa73b1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d9f7a3ebd14c04906ac8a38ec42975, user_id=1010f395a1f248d7ba75fce266ec6226, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:44.888735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8a0d-83e6-40e1-989c-d85bfa73b1b3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:44.915817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e0dda1c7ad46ce80ae01b346b84ca3'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:44.916873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e0dda1c7ad46ce80ae01b346b84ca3'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:44.921198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 857/1711] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:44 2021] PUT /identity/v3/projects/d6d9f7a3ebd14c04906ac8a38ec42975/users/1010f395a1f248d7ba75fce266ec6226/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:44.922894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113e89-7a1b-474a-ab5d-81706e7038ac None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:44.923577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113e89-7a1b-474a-ab5d-81706e7038ac None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:44.924871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113e89-7a1b-474a-ab5d-81706e7038ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:44.941028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e0dda1c7ad46ce80ae01b346b84ca3'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:44.948127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e0dda1c7ad46ce80ae01b346b84ca3'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:44.968432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71e6fe54-2a3f-4dae-b1e5-16bd19652c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e0dda1c7ad46ce80ae01b346b84ca3'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:45.001342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-66113e89-7a1b-474a-ab5d-81706e7038ac None None] MFA Rules not processed for user `5f08db48e9814f7db34ffcf7d581fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:45.005239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 855/1712] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:44 2021] DELETE /identity/v3/users/76e0dda1c7ad46ce80ae01b346b84ca3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:45.011398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-66113e89-7a1b-474a-ab5d-81706e7038ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:45.013240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:45.013583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:45.013937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:45.134118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] MFA Rules not processed for user `1010f395a1f248d7ba75fce266ec6226`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:45.135539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:45.190032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 858/1713] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Dec 14 03:14:44 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:45.193728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:45.196403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:45.197015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:45.282978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:45.290246 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:45.364304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 856/1714] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:45 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:45.365248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:45.367033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:45.400019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4865-2858-410e-9fa0-0f8969c4bb0a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:45.428201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:45.428568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:45.428850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:45.429544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:45.443407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:45.452944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:45.500387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 857/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:45.502339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:45.503468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:45.531853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 859/1716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:45.692375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81767ae7-d57b-4609-b051-5ebb5ac21a4e service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:45.702648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:45.703486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:45.703627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:45.703906 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:45.737333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:45.739104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:45.747705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:45.749576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:45.783971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed352a7-b56b-40f3-8d70-e1880faffb24 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:45.802094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 858/1717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:45 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:45.806208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c00c94-8aad-46cd-be70-47e51c44dd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:45.807600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c00c94-8aad-46cd-be70-47e51c44dd79 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:45.807600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c00c94-8aad-46cd-be70-47e51c44dd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:45.808011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c00c94-8aad-46cd-be70-47e51c44dd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:45.843973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c00c94-8aad-46cd-be70-47e51c44dd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:45.845695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c00c94-8aad-46cd-be70-47e51c44dd79 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:45.892035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 860/1718] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:14:45.973035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:45.984178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202ad46-9969-4bcf-8a91-895a3fd39b62 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:45.997481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:45.998385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:45.998706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:46.000281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:46.007740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:46.212630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:46.214699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772fc8f-b599-40b4-824a-50864abed180 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:46.247999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:46.248296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:46.248560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:46.253772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 859/1719] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:45 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:46.361848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] MFA Rules not processed for user `57a541b5dc154896bced57a79750a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:46.363861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:46.579250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 861/1720] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:46 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:46.589890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:46.590551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:46.590973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:46.646761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] MFA Rules not processed for user `57a541b5dc154896bced57a79750a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:46.661543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:46.690172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 860/1721] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:46 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:46.703722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:46.705626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:46.821494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:46.823454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:46.884773 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90778d-105f-4f87-9ebd-d310507981e8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:46.890622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637de3df-8b08-46d7-a5fd-c71aaa3d543b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:46.899408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4367b-163a-40dc-bef4-1d102befa229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:46.900333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4367b-163a-40dc-bef4-1d102befa229 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:46.900750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4367b-163a-40dc-bef4-1d102befa229 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:46.901169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4367b-163a-40dc-bef4-1d102befa229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:46.907667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:46.908710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:46.908940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:46.909237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] PATH_INFO: `/v3/projects/9ee92ea1c1534fa4b7c1d28398d8d31b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:46.915228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee92ea1c1534fa4b7c1d28398d8d31b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:46.918667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4367b-163a-40dc-bef4-1d102befa229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:46.919793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:46.922519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4367b-163a-40dc-bef4-1d102befa229 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:46.960442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 862/1722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:46 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:47.093331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee92ea1c1534fa4b7c1d28398d8d31b', 'request_id': 'req-8deba118-2686-4d85-97c7-34920557a72f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.111948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee92ea1c1534fa4b7c1d28398d8d31b', 'request_id': 'req-8deba118-2686-4d85-97c7-34920557a72f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.129221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee92ea1c1534fa4b7c1d28398d8d31b', 'request_id': 'req-8deba118-2686-4d85-97c7-34920557a72f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.151061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] The token cache is being invalidate because project 9ee92ea1c1534fa4b7c1d28398d8d31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:47.151450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.153715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.160370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 861/1723] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:46 2021] DELETE /identity/v3/projects/9ee92ea1c1534fa4b7c1d28398d8d31b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:47.162569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad764ea-b482-45d3-a6ac-974744db4006 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:47.162919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad764ea-b482-45d3-a6ac-974744db4006 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:47.163429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad764ea-b482-45d3-a6ac-974744db4006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:47.222852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7ad764ea-b482-45d3-a6ac-974744db4006 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:47.238592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7ad764ea-b482-45d3-a6ac-974744db4006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:47.317024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:47.319072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:47.449872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 863/1724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:47.459796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:47.460083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:47.460375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:47.490350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba118-2686-4d85-97c7-34920557a72f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:47.500424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:47.503083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:47.504063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:47.504344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:47.504617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] PATH_INFO: `/v3/users/0ee69c549caa4a7585c89eaf631872cb` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:47.506333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:47.508041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee69c549caa4a7585c89eaf631872cb)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:47.509964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:47.532070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 864/1725] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:47.537104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:47.553643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c67d4-432e-47cc-82c6-4aa7fa3a16c5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:47.573161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:47.573845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:47.574122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:47.578067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:47.578877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:47.579209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:47.580843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:47.627975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 865/1726] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:14:47.635635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:47.639730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee69c549caa4a7585c89eaf631872cb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.642396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee69c549caa4a7585c89eaf631872cb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.653061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8aaaa-13ee-4701-8598-b948d79e9f24 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:47.688352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee69c549caa4a7585c89eaf631872cb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.689494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee69c549caa4a7585c89eaf631872cb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.698785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:47.699491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:47.699767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:47.700036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:47.700803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:47.702670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:47.715407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a70ae0e-e1cd-452a-a0f6-a44214bcbe5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee69c549caa4a7585c89eaf631872cb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:47.753215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 862/1727] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:47 2021] DELETE /identity/v3/users/0ee69c549caa4a7585c89eaf631872cb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:47.761337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3d96a-704d-4c61-b034-aaf2743202cf None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:47.761337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3d96a-704d-4c61-b034-aaf2743202cf None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:47.761337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3d96a-704d-4c61-b034-aaf2743202cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:47.809104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 866/1728] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:47 2021] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:47.812526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:47.818656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:47.832167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4ff3d96a-704d-4c61-b034-aaf2743202cf None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:47.836453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4ff3d96a-704d-4c61-b034-aaf2743202cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:47.975784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c1ee-e4c7-45c2-a1cf-f7a297223f52 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:47.997897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668a10-0a9f-4c8e-ae35-6056bd7b0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.001668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668a10-0a9f-4c8e-ae35-6056bd7b0fef admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.001963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668a10-0a9f-4c8e-ae35-6056bd7b0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.004150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668a10-0a9f-4c8e-ae35-6056bd7b0fef admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.004849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668a10-0a9f-4c8e-ae35-6056bd7b0fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.019581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668a10-0a9f-4c8e-ae35-6056bd7b0fef admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.045772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 863/1729] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:48.047323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90f7f5-cfbc-42b7-83e2-c2355bcc51f6 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.047722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90f7f5-cfbc-42b7-83e2-c2355bcc51f6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.056248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90f7f5-cfbc-42b7-83e2-c2355bcc51f6 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.069648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 864/1730] 10.222.0.43 () {54 vars in 912 bytes} [Tue Dec 14 03:14:48 2021] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:48.070695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90f7f5-cfbc-42b7-83e2-c2355bcc51f6 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:48.080055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cb90f7f5-cfbc-42b7-83e2-c2355bcc51f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:48.121383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 867/1731] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:47 2021] POST /identity/v3/users => generated 286 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:48.123542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.124556 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.124556 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.165226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] MFA Rules not processed for user `5f08db48e9814f7db34ffcf7d581fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:48.167446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:48.261171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90f7f5-cfbc-42b7-83e2-c2355bcc51f6 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:48.272194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.273234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.273733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.274215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.302690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.306872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.338907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 868/1732] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:48.340751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:48.358280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 865/1733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:48.360616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3180b-781e-43cb-aa4d-928c760ebc76 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:48.367333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.368015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.368303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.368633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.369009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:48.369388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.371078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.372124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:48.387422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 869/1734] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:48.387422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:48.402189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6c9b-be60-46a1-86ce-4145faac8437 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:48.413858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995876b4-119d-4d27-a984-9f47a74b837e service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:48.415759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.416734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.417098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.417729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.426009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.426892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.427755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.428037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] PATH_INFO: `/v3/projects/3af55fe172424f0697f23b6098078253` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.431134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af55fe172424f0697f23b6098078253)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.432445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.433120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.434271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.451331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 870/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:48.453846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:48.478840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8bbd-be42-4919-8e42-74673178a791 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:48.492838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.493683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.494078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.494468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.495355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.497456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.523091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 871/1736] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:48.528911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af55fe172424f0697f23b6098078253', 'request_id': 'req-9b4dd81e-f32f-4d15-a8fc-436540cfa250'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:48.530114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:48.542384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af55fe172424f0697f23b6098078253', 'request_id': 'req-9b4dd81e-f32f-4d15-a8fc-436540cfa250'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:48.549270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7463-19d2-43f1-ae4b-2ab69b48b447 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:48.556917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af55fe172424f0697f23b6098078253', 'request_id': 'req-9b4dd81e-f32f-4d15-a8fc-436540cfa250'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:48.576021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] The token cache is being invalidate because project 3af55fe172424f0697f23b6098078253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:48.577594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:48.578485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b4dd81e-f32f-4d15-a8fc-436540cfa250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:48.587974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 866/1737] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:48 2021] DELETE /identity/v3/projects/3af55fe172424f0697f23b6098078253 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:14:48.590541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca4de-c392-4067-afad-31550af3237e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.591103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca4de-c392-4067-afad-31550af3237e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.591560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca4de-c392-4067-afad-31550af3237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.619003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-7d3ca4de-c392-4067-afad-31550af3237e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:48.625777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7d3ca4de-c392-4067-afad-31550af3237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:48.679903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04941e3-4b19-431c-9503-7baefce15f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:48.680969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04941e3-4b19-431c-9503-7baefce15f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.681313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04941e3-4b19-431c-9503-7baefce15f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.681794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04941e3-4b19-431c-9503-7baefce15f03 admin admin] PATH_INFO: `/v3/projects/3286a311faa64f1cbb3841e589a72532/users/61e846a254ce413098321bec3c3e1491/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.721635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04941e3-4b19-431c-9503-7baefce15f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3286a311faa64f1cbb3841e589a72532, user_id=61e846a254ce413098321bec3c3e1491, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:48.725306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04941e3-4b19-431c-9503-7baefce15f03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:48.736102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 867/1738] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:48.774499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 872/1739] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:48 2021] PUT /identity/v3/projects/3286a311faa64f1cbb3841e589a72532/users/61e846a254ce413098321bec3c3e1491/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:48.779972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.780435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.784641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.811839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0874f-de39-48cc-b043-83216c19ecdd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:48.812616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0874f-de39-48cc-b043-83216c19ecdd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:48.813110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0874f-de39-48cc-b043-83216c19ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:48.883316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d1f0874f-de39-48cc-b043-83216c19ecdd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:48.884932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d1f0874f-de39-48cc-b043-83216c19ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:48.900061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] MFA Rules not processed for user `0a4d52d1d56e44fe97650262ca2e68df`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:48.901840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:49.049954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 873/1740] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:49.051731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.053222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.053222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.071427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 868/1741] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:48 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:49.071427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.092521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609130a7-441f-4bc3-b201-85b798509e42 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.105931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.111854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.112416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.114963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.115935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:49.116668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.121265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.124932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] MFA Rules not processed for user `61e846a254ce413098321bec3c3e1491`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:49.129516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:49.150412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 869/1742] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:14:49.154479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.177920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f279-51ba-47b3-9e1c-d2e077e915de admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.193344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.194189 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.194647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.195073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.196537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.201523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.306192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 870/1743] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:49 2021] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:49.308219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.346612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 874/1744] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:49 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:49.365307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.367382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:49.394247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d2a2-0030-4653-95e2-524b581c4627 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.490816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384214dc-f529-4781-ae5e-f4aea9bd36d1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.509295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.510376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.510903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.511421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.512354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.518130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.566416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 871/1745] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:49 2021] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:49.570313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.601189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.601619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.601930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.602211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.605087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.607439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.608212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310254b-72ba-4bce-b212-cc81cc897994 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.640976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.641669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.641955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.642233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.646456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.648120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.679334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 875/1746] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:49 2021] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:49.680958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.723577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 872/1747] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:49 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:49.724660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.759909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0edd8-517f-44ee-b5ad-5272f46fea4b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.881138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92234974-46e1-4a44-aff3-8fa4edcbb462 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:49.897543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.898490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.899652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.900099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.902950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.907399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.915011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:49.916873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:49.917149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:49.918689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:49.919740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:49.923073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:49.954473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 873/1748] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:49 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:49.954473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:49.958663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:49.998166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 876/1749] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:49 2021] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:14:49.999188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:50.065624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f54908-1988-4ecb-926f-e3772d0242f9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:50.086670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:50.090712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.091002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.093706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] PATH_INFO: `/v3/projects/65451d8f7a0f4d53ad8165afb84586f2/users/e3bc01667b154da497de866bdfd61466/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.182548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65451d8f7a0f4d53ad8165afb84586f2, user_id=e3bc01667b154da497de866bdfd61466, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:50.195206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:50.256705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa9387-e26d-4453-86f0-fd0b74448ff9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:50.266465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 877/1750] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:49 2021] PUT /identity/v3/projects/65451d8f7a0f4d53ad8165afb84586f2/users/e3bc01667b154da497de866bdfd61466/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:50.270300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:50.443940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:50.445791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.446354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.446783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.536156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2debb5-4f1c-4351-81fa-62cfa0750444 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:50.562841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23d74c-effd-4015-8dab-74da6a984430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:50.563939 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d74c-effd-4015-8dab-74da6a984430 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.564315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d74c-effd-4015-8dab-74da6a984430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.564623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d74c-effd-4015-8dab-74da6a984430 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.565429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23d74c-effd-4015-8dab-74da6a984430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:50.571365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23d74c-effd-4015-8dab-74da6a984430 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:50.586083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 878/1751] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:50 2021] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:50.587476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33e625-2486-4d12-8d44-c1b477f3ed5b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.587804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33e625-2486-4d12-8d44-c1b477f3ed5b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.588154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33e625-2486-4d12-8d44-c1b477f3ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.612901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:50.618279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:50.619394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2d33e625-2486-4d12-8d44-c1b477f3ed5b None None] MFA Rules not processed for user `57a541b5dc154896bced57a79750a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:50.620655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2d33e625-2486-4d12-8d44-c1b477f3ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:50.638058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 874/1752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:49 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:50.638903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:50.644240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:50.677822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a6de4-1cff-41d7-95da-bec94c0785bb service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:50.687630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:50.688235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.688523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.688825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] PATH_INFO: `/v3/projects/241f70f0c752454fad3f39dcca6f9bc3` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.690726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=241f70f0c752454fad3f39dcca6f9bc3)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:50.693330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:50.761405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 879/1753] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:50 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:50.774973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.775304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.775596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.862080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241f70f0c752454fad3f39dcca6f9bc3', 'request_id': 'req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:50.886559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241f70f0c752454fad3f39dcca6f9bc3', 'request_id': 'req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:50.908148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241f70f0c752454fad3f39dcca6f9bc3', 'request_id': 'req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:50.936242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] The token cache is being invalidate because project 241f70f0c752454fad3f39dcca6f9bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:50.936534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:50.937356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-03cb78c7-6df1-4ccd-8857-ed030ba74e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:50.939319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 875/1754] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:50 2021] DELETE /identity/v3/projects/241f70f0c752454fad3f39dcca6f9bc3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:50.940764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e79ed-fe13-4993-a9ec-a15f0be5a003 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:50.941203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e79ed-fe13-4993-a9ec-a15f0be5a003 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:50.941643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e79ed-fe13-4993-a9ec-a15f0be5a003 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:50.944740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 876/1755] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:14:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:14:50.945637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e79ed-fe13-4993-a9ec-a15f0be5a003 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:50.948094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d69e79ed-fe13-4993-a9ec-a15f0be5a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:50.948239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] MFA Rules not processed for user `e3bc01667b154da497de866bdfd61466`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:50.949309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:51.131352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 880/1756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:50 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:51.132430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:51.136343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:51.143194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e79ed-fe13-4993-a9ec-a15f0be5a003 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:51.154690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:51.156054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:51.156502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:51.156932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] PATH_INFO: `/v3/projects/708fffa8a2d749d8be627a480a3a32f1/users/1e016056eca14a20bdf46cfcfa52337b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:51.176960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5bb1-87b9-428e-9532-f00186bb6fc9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:51.194856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:51.196018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=708fffa8a2d749d8be627a480a3a32f1, user_id=1e016056eca14a20bdf46cfcfa52337b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:51.198685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:51.198975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:51.199968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] PATH_INFO: `/v3/users/ca44d6ebedae42159da8a7f0f003ee50` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:51.200848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:51.204848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca44d6ebedae42159da8a7f0f003ee50)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:51.209468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:51.229846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 877/1757] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:50 2021] PUT /identity/v3/projects/708fffa8a2d749d8be627a480a3a32f1/users/1e016056eca14a20bdf46cfcfa52337b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:51.230857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:51.240717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:51.345566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca44d6ebedae42159da8a7f0f003ee50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:51.363756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca44d6ebedae42159da8a7f0f003ee50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:51.365796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca44d6ebedae42159da8a7f0f003ee50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:51.395144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca44d6ebedae42159da8a7f0f003ee50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:51.416936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-20e2683f-ef16-4b27-9bc7-fea364eb12b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca44d6ebedae42159da8a7f0f003ee50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:51.424455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce52-1157-4fbe-9c3e-332aac763d2b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:51.442588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 881/1758] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:51 2021] DELETE /identity/v3/users/ca44d6ebedae42159da8a7f0f003ee50 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:51.445268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:51.446732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:51.447005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:51.494037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:51.496244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:51.625148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:51.634851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:51.634851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:51.634851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:51.634851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:51.637214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:51.749705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 878/1759] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:51 2021] POST /identity/v3/projects => generated 383 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:51.750922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:51.772253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:51.810352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 882/1760] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:14:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:51.815692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:51.827312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:51.909964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7237e-68aa-46ea-9448-c39f4ea7aeb5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:52.023456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8aa70-0d0f-45f7-8fee-924c0ca8c156 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:52.054944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:52.055713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:52.056576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:52.056861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:52.057617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:52.068518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:52.090017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:52.090708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:52.090991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:52.091331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:52.092047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:52.097344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:52.128453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 879/1761] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:51 2021] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:52.142373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:52.179676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc26c-be6f-4f0a-aa90-10caecdaead8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:52.195922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 883/1762] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:51 2021] POST /identity/v3/users => generated 298 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:52.197896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:52.199722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b138-0da5-460a-9a98-25ef8ee01816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:52.200629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b138-0da5-460a-9a98-25ef8ee01816 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:52.200908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b138-0da5-460a-9a98-25ef8ee01816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:52.201186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b138-0da5-460a-9a98-25ef8ee01816 admin admin] PATH_INFO: `/v3/projects/708fffa8a2d749d8be627a480a3a32f1/users/1e016056eca14a20bdf46cfcfa52337b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:52.236451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5515-7fc6-4623-acbb-c9520c28679b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:52.244493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282b138-0da5-460a-9a98-25ef8ee01816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708fffa8a2d749d8be627a480a3a32f1, user_id=1e016056eca14a20bdf46cfcfa52337b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:52.247273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282b138-0da5-460a-9a98-25ef8ee01816 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:52.254469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:52.256455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:52.256917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:52.257459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:52.258572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:52.262700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:52.293294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 884/1763] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:52.298008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:52.315588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 880/1764] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:52 2021] PUT /identity/v3/projects/708fffa8a2d749d8be627a480a3a32f1/users/1e016056eca14a20bdf46cfcfa52337b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:14:52.337053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:52.337333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:52.337619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:52.342984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7b78-0bec-4395-8d77-cb1ec880372b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:52.443953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] MFA Rules not processed for user `1e016056eca14a20bdf46cfcfa52337b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:52.446600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:52.590293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:52.591578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:52.602285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:52.602812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] PATH_INFO: `/v3/projects/77fa1b12905b450f870fbf2ff3b9299b/users/4d897cdac06b4e439d516bac487ce8b2/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:52.654145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fa1b12905b450f870fbf2ff3b9299b, user_id=4d897cdac06b4e439d516bac487ce8b2, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:52.666231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 881/1765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:52 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:52.683454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:52.686230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:52.713480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:52.799024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 885/1766] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:52 2021] PUT /identity/v3/projects/77fa1b12905b450f870fbf2ff3b9299b/users/4d897cdac06b4e439d516bac487ce8b2/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:52.805275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:52.811755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:53.002055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d5558-5e13-4d2a-bb91-220113eef8ac None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:53.164679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:53.165367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:53.165654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:53.165935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:53.191337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ae676-468f-4897-8514-846f01967a6b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:53.215596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:53.216272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:53.226003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:53.226456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:53.263241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:53.274056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:53.319548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 886/1767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:53.324741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:53.486713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:53.492778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:53.588620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 882/1768] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:52 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 906 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:53.617729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b6cd-c17b-470d-b65c-c240a3829886 service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:53.642099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:53.642795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:53.643097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:53.643374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:53.649159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:53.661088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:53.698557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:53.701141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:53.736146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 887/1769] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:53 2021] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:53.739330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:53.763414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054932-6ceb-4ef5-99a6-dee1106521f9 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:53.778038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b362-15bb-4b8d-8c48-289550323ed9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:53.781847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:53.785016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:53.794961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa502d-bca1-49b0-b289-e1eb0bcc95f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:53.796407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa502d-bca1-49b0-b289-e1eb0bcc95f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:53.796698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa502d-bca1-49b0-b289-e1eb0bcc95f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:53.797856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa502d-bca1-49b0-b289-e1eb0bcc95f2 admin admin] PATH_INFO: `/v3/projects/77fa1b12905b450f870fbf2ff3b9299b/users/4d897cdac06b4e439d516bac487ce8b2/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:53.802192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:53.803466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] PATH_INFO: `/v3/projects/cc9f0af4793a478ba83ea3502eb102c7` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:53.804526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa502d-bca1-49b0-b289-e1eb0bcc95f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fa1b12905b450f870fbf2ff3b9299b, user_id=4d897cdac06b4e439d516bac487ce8b2, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:53.807932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa502d-bca1-49b0-b289-e1eb0bcc95f2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:53.812519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9f0af4793a478ba83ea3502eb102c7)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:53.815112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:53.842302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 888/1770] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:53 2021] PUT /identity/v3/projects/77fa1b12905b450f870fbf2ff3b9299b/users/4d897cdac06b4e439d516bac487ce8b2/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:53.853481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:53.854237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:53.854666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:53.907271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] MFA Rules not processed for user `4d897cdac06b4e439d516bac487ce8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:53.918194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:54.017775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 889/1771] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:53 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:54.029608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:54.032188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:54.090390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9f0af4793a478ba83ea3502eb102c7', 'request_id': 'req-b93c819e-f959-4815-a03f-72980b026d6e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.124212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9f0af4793a478ba83ea3502eb102c7', 'request_id': 'req-b93c819e-f959-4815-a03f-72980b026d6e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.136687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9f0af4793a478ba83ea3502eb102c7', 'request_id': 'req-b93c819e-f959-4815-a03f-72980b026d6e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.206209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] The token cache is being invalidate because project cc9f0af4793a478ba83ea3502eb102c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:54.209158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.214085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.225985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 883/1772] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:53 2021] DELETE /identity/v3/projects/cc9f0af4793a478ba83ea3502eb102c7 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:14:54.230437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:54.233589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:54.260553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26710f0f-1a93-4f8a-b16a-ed606713252e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:54.409293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c819e-f959-4815-a03f-72980b026d6e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:54.424652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:54.425602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:54.425886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:54.426159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] PATH_INFO: `/v3/users/943889a0d569437484425554150dfa1a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:54.427953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943889a0d569437484425554150dfa1a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:54.429996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:54.541963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:54.544552 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:54.547748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:54.548098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:54.560551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:54.580807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943889a0d569437484425554150dfa1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.588540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943889a0d569437484425554150dfa1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.618586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943889a0d569437484425554150dfa1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.619666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943889a0d569437484425554150dfa1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.655250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943889a0d569437484425554150dfa1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:54.687699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 884/1773] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:54 2021] DELETE /identity/v3/users/943889a0d569437484425554150dfa1a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:54.688796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:54.703198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:54.845594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:54.847699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:54.897685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 890/1774] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:54 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 868 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:54.953310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f5a78-dcbc-40f7-9688-2f9829e4e7e7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:54.975072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:54.976419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:54.982597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:54.982895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] PATH_INFO: `/v3/users/61e846a254ce413098321bec3c3e1491` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:54.998141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e846a254ce413098321bec3c3e1491)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:55.002325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:55.086634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:55.092969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:55.118208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2dad-456b-412a-b087-26d735db60af service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:55.143697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e846a254ce413098321bec3c3e1491'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:55.144585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e846a254ce413098321bec3c3e1491'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:55.174211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e846a254ce413098321bec3c3e1491'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:55.175231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e846a254ce413098321bec3c3e1491'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:55.191873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9d0ebcbb-aa67-4c6e-813f-771c98e35178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e846a254ce413098321bec3c3e1491'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:55.243385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 885/1775] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:54 2021] DELETE /identity/v3/users/61e846a254ce413098321bec3c3e1491 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:55.247826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cadeee-a486-4223-b53c-a55a2a707f1a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:55.248114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cadeee-a486-4223-b53c-a55a2a707f1a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:55.248399 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cadeee-a486-4223-b53c-a55a2a707f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:55.278728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:55.280818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:55.281493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:55.282234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:55.290584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:55.328695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b9cadeee-a486-4223-b53c-a55a2a707f1a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:55.332436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b9cadeee-a486-4223-b53c-a55a2a707f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:55.512278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:55.519521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:55.537646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 891/1776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:55 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:55.604860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 886/1777] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:55.677425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:55.679731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:55.728619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:55.729826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:55.730538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:55.820577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] MFA Rules not processed for user `107444106cda461dab7c403665d92613`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:55.823745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:56.017990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631c511-e5c6-496b-82bf-48932707bc39 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:56.093695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 887/1778] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:55 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:14:56.108626 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:56.110124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:56.214578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:56.215261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:56.215719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:56.216138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:56.265046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:56.266494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:56.304586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 892/1779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:14:56.449256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5266-f8d2-46c1-a023-a6546b081487 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:56.485542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61425f-80d9-4cdd-a57e-dae61076c7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:56.486217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61425f-80d9-4cdd-a57e-dae61076c7fe service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:56.486497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61425f-80d9-4cdd-a57e-dae61076c7fe service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:56.486765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61425f-80d9-4cdd-a57e-dae61076c7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:56.517337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61425f-80d9-4cdd-a57e-dae61076c7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:56.522976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61425f-80d9-4cdd-a57e-dae61076c7fe service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:56.539819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 888/1780] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:56 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:14:57.235230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:57.237234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:57.273851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431222b6-bd28-4f18-97e2-eac758966ff8 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:57.299762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:57.301331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:57.301892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:57.302420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] PATH_INFO: `/v3/projects/a550c996fab444e09c88fd4e8f79e423` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:57.304843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a550c996fab444e09c88fd4e8f79e423)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:57.308350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:57.445037 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a550c996fab444e09c88fd4e8f79e423', 'request_id': 'req-6b34226d-e6c1-46da-9592-87846eef5c50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:57.454375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a550c996fab444e09c88fd4e8f79e423', 'request_id': 'req-6b34226d-e6c1-46da-9592-87846eef5c50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:57.474774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a550c996fab444e09c88fd4e8f79e423', 'request_id': 'req-6b34226d-e6c1-46da-9592-87846eef5c50'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:57.489830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] The token cache is being invalidate because project a550c996fab444e09c88fd4e8f79e423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:57.490164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:57.490942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6b34226d-e6c1-46da-9592-87846eef5c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:57.492768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 893/1781] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:57 2021] DELETE /identity/v3/projects/a550c996fab444e09c88fd4e8f79e423 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:57.499717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:57.500376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:57.500376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:57.541708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:57.544221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:57.741392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:57.741678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:57.745519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:57.750706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 889/1782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:57.786922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:57.794313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:57.825281 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:57.831106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 894/1783] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:57.857075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a3443-9e38-4dbf-8f56-78798c3e8c62 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:57.868476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:57.869194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:57.869526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:57.869800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:57.870850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:14:57.871180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:57.877057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:57.912374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:57.922494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 890/1784] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:14:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:14:57.924686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a1dc-277c-4a38-9dbb-740ba2a7f456 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:57.942217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:57.942935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:57.943244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:57.943513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:57.944236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:57.946444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:58.041713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:58.048809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 895/1785] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:57 2021] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:58.053464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86594c7a-97dc-476e-98df-9a2bc0b59cfd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:58.139938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:58.143512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:58.144172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:58.144649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:58.146457 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:58.152910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:58.205367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 891/1786] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:58 2021] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:58.206653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:58.229549 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691cc1-4b58-4a80-afbe-568c50f4499d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:58.250467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:58.253004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:58.253908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:58.256121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:58.259130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:58.266240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:58.295431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 896/1787] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:58 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:58.299230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:58.313230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14705eaa-5c16-4855-8899-ee4c6b2f36fe admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:58.331426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1c64a-5ece-4a79-8e42-d38b26b31203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:58.333441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1c64a-5ece-4a79-8e42-d38b26b31203 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:58.335322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1c64a-5ece-4a79-8e42-d38b26b31203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:58.336420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1c64a-5ece-4a79-8e42-d38b26b31203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:58.337357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1c64a-5ece-4a79-8e42-d38b26b31203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:58.340744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1c64a-5ece-4a79-8e42-d38b26b31203 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:58.392367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 892/1788] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:58 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:58.393555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:58.414267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b4aaf-aafe-40af-816f-9cef4b5cccfb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:58.419748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:58.420866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:58.421303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:58.421785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] PATH_INFO: `/v3/projects/164f0ca19b984eebb1c8f272ac74a98a/users/4b47cc2d36db4cbba08cbbfb1e936465/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:58.456579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164f0ca19b984eebb1c8f272ac74a98a, user_id=4b47cc2d36db4cbba08cbbfb1e936465, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:58.460397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:58.493151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 897/1789] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:58 2021] PUT /identity/v3/projects/164f0ca19b984eebb1c8f272ac74a98a/users/4b47cc2d36db4cbba08cbbfb1e936465/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:58.506191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654252a0-0b98-4d42-9906-97b090637caa None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:58.506770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654252a0-0b98-4d42-9906-97b090637caa None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:58.506770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654252a0-0b98-4d42-9906-97b090637caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:58.598494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-654252a0-0b98-4d42-9906-97b090637caa None None] MFA Rules not processed for user `4b47cc2d36db4cbba08cbbfb1e936465`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:58.599919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-654252a0-0b98-4d42-9906-97b090637caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:58.778358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 893/1790] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:58 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:58.779144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:58.938751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358c2f-cb9d-4172-90d5-519ff1252347 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:58.963554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:58.975789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:58.976736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:58.977525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:58.979757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:58.984121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.062073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 898/1791] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:14:58 2021] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:14:59.066354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654252a0-0b98-4d42-9906-97b090637caa None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.088404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654252a0-0b98-4d42-9906-97b090637caa None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:59.089505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.091568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.210001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc6ebd-6522-4cd5-920d-9210e5816b17 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:59.212817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:59.213411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.213768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.214117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.214900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:59.216960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.217439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:59.218427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.219096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.219096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] PATH_INFO: `/v3/users/e3bc01667b154da497de866bdfd61466` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.220558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3bc01667b154da497de866bdfd61466)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:59.222904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.257609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 894/1792] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:14:59 2021] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:14:59.258903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.261223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.281859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626db3c-056c-46c1-a5ca-ee9d1c174b62 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:59.289309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:59.290541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.291207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.291440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] PATH_INFO: `/v3/projects/3286a311faa64f1cbb3841e589a72532` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.293587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3286a311faa64f1cbb3841e589a72532)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:59.295370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.307623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3bc01667b154da497de866bdfd61466'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.330030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3bc01667b154da497de866bdfd61466'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.330910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3bc01667b154da497de866bdfd61466'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.353271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3bc01667b154da497de866bdfd61466'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.379030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3bc01667b154da497de866bdfd61466'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.394371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 899/1793] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:59 2021] DELETE /identity/v3/users/e3bc01667b154da497de866bdfd61466 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:59.397239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.401218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.459646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3286a311faa64f1cbb3841e589a72532', 'request_id': 'req-cf6789e7-513b-448e-8a85-41c62828202b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.474639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3286a311faa64f1cbb3841e589a72532', 'request_id': 'req-cf6789e7-513b-448e-8a85-41c62828202b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.483610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8820-cf83-42bc-8cb6-a8f680a4c195 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:59.493903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3286a311faa64f1cbb3841e589a72532', 'request_id': 'req-cf6789e7-513b-448e-8a85-41c62828202b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.511083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] The token cache is being invalidate because project 3286a311faa64f1cbb3841e589a72532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:14:59.513374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.514114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cf6789e7-513b-448e-8a85-41c62828202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.516386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 895/1794] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:14:59 2021] DELETE /identity/v3/projects/3286a311faa64f1cbb3841e589a72532 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:59.518680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.521082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.521460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.566576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:14:59.569703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.597803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:59.599229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.600238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.600992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.602098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:59.604049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.622582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 900/1795] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:59 2021] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:14:59.623852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.645934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.689011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23160c44-3a81-4c7f-a94a-946be243ab7f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:59.705888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:59.706778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.707076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.707363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] PATH_INFO: `/v3/users/1e016056eca14a20bdf46cfcfa52337b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.710277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e016056eca14a20bdf46cfcfa52337b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:59.712276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.808744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 896/1796] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:14:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:14:59.810247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.811966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.837508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e016056eca14a20bdf46cfcfa52337b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.843954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddf5e-49da-4384-b618-d44eaec42272 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:14:59.850667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:14:59.851922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:14:59.852449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:14:59.853005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] PATH_INFO: `/v3/projects/b5224adb55d5434aa97c0cbffb14693e/users/b736eb5bdf8449688ca63d82c71c28ef/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:14:59.856016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e016056eca14a20bdf46cfcfa52337b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.862354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e016056eca14a20bdf46cfcfa52337b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.888101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5224adb55d5434aa97c0cbffb14693e, user_id=b736eb5bdf8449688ca63d82c71c28ef, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:14:59.893046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:14:59.912743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e016056eca14a20bdf46cfcfa52337b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.916376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 897/1797] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:14:59 2021] PUT /identity/v3/projects/b5224adb55d5434aa97c0cbffb14693e/users/b736eb5bdf8449688ca63d82c71c28ef/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:59.917565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.920008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:14:59.937639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e016056eca14a20bdf46cfcfa52337b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:14:59.945933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 901/1798] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:14:59 2021] DELETE /identity/v3/users/1e016056eca14a20bdf46cfcfa52337b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:14:59.946785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:14:59.949229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:00.028855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49545a-cc20-4263-aacb-497ebaa28800 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:00.078282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc42437-8354-468a-b77d-a751d3ccc279 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:00.094346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:00.095481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:00.095954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:00.097149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:00.097994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:00.099773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:00.111678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 902/1799] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:14:59 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:00.122124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:00.136432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00adad-b7f6-417e-af11-c69b9920dad4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:00.144448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1de14-4069-4dca-92d7-9faec41db796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:00.146127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1de14-4069-4dca-92d7-9faec41db796 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:00.147410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1de14-4069-4dca-92d7-9faec41db796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:00.148055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1de14-4069-4dca-92d7-9faec41db796 admin admin] PATH_INFO: `/v3/projects/b5224adb55d5434aa97c0cbffb14693e/users/b736eb5bdf8449688ca63d82c71c28ef/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:00.161844 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1de14-4069-4dca-92d7-9faec41db796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5224adb55d5434aa97c0cbffb14693e, user_id=b736eb5bdf8449688ca63d82c71c28ef, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:00.165412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1de14-4069-4dca-92d7-9faec41db796 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:00.170467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:00.171226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:00.171497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:00.171777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:00.182067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:00.186732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 903/1800] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:00 2021] PUT /identity/v3/projects/b5224adb55d5434aa97c0cbffb14693e/users/b736eb5bdf8449688ca63d82c71c28ef/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:00.198997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198cb4-79b9-402d-a9bf-87f48d131d43 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:00.199391 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198cb4-79b9-402d-a9bf-87f48d131d43 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:00.199664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198cb4-79b9-402d-a9bf-87f48d131d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:00.219567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:00.233846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:00.280782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 898/1801] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:14:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:00.284534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7c198cb4-79b9-402d-a9bf-87f48d131d43 None None] MFA Rules not processed for user `b736eb5bdf8449688ca63d82c71c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:00.285983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7c198cb4-79b9-402d-a9bf-87f48d131d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:00.399830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:00.401278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:00.404205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 904/1802] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:00.548133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb73d3-09e5-4d71-b9aa-81c15e877993 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:00.687675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:00.688935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:00.690430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:00.691070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:00.720711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:00.724990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:00.767274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 899/1803] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:00 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:01.104345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:01.104803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:01.105101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:01.150001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] MFA Rules not processed for user `0a4d52d1d56e44fe97650262ca2e68df`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:01.152486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:01.268082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 905/1804] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:01 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:01.291786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:01.293422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:01.403852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021f806-0a29-4be4-9dcc-accc29a31875 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:01.415643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:01.416776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:01.417194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:01.417779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] PATH_INFO: `/v3/projects/65451d8f7a0f4d53ad8165afb84586f2` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:01.419275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65451d8f7a0f4d53ad8165afb84586f2)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:01.421763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:01.501179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65451d8f7a0f4d53ad8165afb84586f2', 'request_id': 'req-6410c077-ec1b-4908-886b-96454fc18b86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.513380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65451d8f7a0f4d53ad8165afb84586f2', 'request_id': 'req-6410c077-ec1b-4908-886b-96454fc18b86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.531347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65451d8f7a0f4d53ad8165afb84586f2', 'request_id': 'req-6410c077-ec1b-4908-886b-96454fc18b86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.547667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] The token cache is being invalidate because project 65451d8f7a0f4d53ad8165afb84586f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:01.547917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.548935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.551300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 900/1805] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:01 2021] DELETE /identity/v3/projects/65451d8f7a0f4d53ad8165afb84586f2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:01.556023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:01.571737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecab657-faa4-4aae-a67b-f4538b205de9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:01.697293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:01.701087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:01.701391 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:01.704009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] PATH_INFO: `/v3/users/4d897cdac06b4e439d516bac487ce8b2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:01.706164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d897cdac06b4e439d516bac487ce8b2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:01.711508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:01.761962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:01.763991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:01.793261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c077-ec1b-4908-886b-96454fc18b86 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:01.808002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:01.811947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:01.811947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:01.811947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] PATH_INFO: `/v3/projects/708fffa8a2d749d8be627a480a3a32f1` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:01.811947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=708fffa8a2d749d8be627a480a3a32f1)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:01.819230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:01.822152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d897cdac06b4e439d516bac487ce8b2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.844958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d897cdac06b4e439d516bac487ce8b2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.846228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d897cdac06b4e439d516bac487ce8b2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.880671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d897cdac06b4e439d516bac487ce8b2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.896982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d897cdac06b4e439d516bac487ce8b2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.910462 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 906/1806] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:01 2021] DELETE /identity/v3/users/4d897cdac06b4e439d516bac487ce8b2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:01.911810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:01.913434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:01.934533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708fffa8a2d749d8be627a480a3a32f1', 'request_id': 'req-dc080887-d91d-4a9a-9652-8c5bd4648a4f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.944389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708fffa8a2d749d8be627a480a3a32f1', 'request_id': 'req-dc080887-d91d-4a9a-9652-8c5bd4648a4f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.962874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708fffa8a2d749d8be627a480a3a32f1', 'request_id': 'req-dc080887-d91d-4a9a-9652-8c5bd4648a4f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.979960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] The token cache is being invalidate because project 708fffa8a2d749d8be627a480a3a32f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:01.980495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.981521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-dc080887-d91d-4a9a-9652-8c5bd4648a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:01.984197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 901/1807] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:01 2021] DELETE /identity/v3/projects/708fffa8a2d749d8be627a480a3a32f1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:01.991549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e3a3-6817-4d50-81f2-c470e7c18bbc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:01.991835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e3a3-6817-4d50-81f2-c470e7c18bbc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:01.995604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e3a3-6817-4d50-81f2-c470e7c18bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.048420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-74a3e3a3-6817-4d50-81f2-c470e7c18bbc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:02.056675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-74a3e3a3-6817-4d50-81f2-c470e7c18bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.064408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518da27-f4cd-4554-8950-ca809e0f7bd8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.074922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 902/1808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:02.075627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.076480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.076761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.077035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] PATH_INFO: `/v3/users/4b47cc2d36db4cbba08cbbfb1e936465` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.083673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.083969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.084249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.086357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b47cc2d36db4cbba08cbbfb1e936465)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.088345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.122780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:02.134667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.158716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 903/1809] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:02.164598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.169897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b47cc2d36db4cbba08cbbfb1e936465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:02.181923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b47cc2d36db4cbba08cbbfb1e936465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:02.183352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b47cc2d36db4cbba08cbbfb1e936465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:02.185070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65029b-8557-4a4c-b84d-8a58dc74774e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.193159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.194873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.195739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.196126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.197533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:02.197932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.200504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.200881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b47cc2d36db4cbba08cbbfb1e936465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:02.223070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5626714d-70cc-47a8-9f7c-064e6a2671d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b47cc2d36db4cbba08cbbfb1e936465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:02.224578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 904/1810] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:02.225860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.227666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.243654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 907/1811] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:01 2021] DELETE /identity/v3/users/4b47cc2d36db4cbba08cbbfb1e936465 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:02.250442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a8638-5763-4562-884c-e9bec975b948 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.261512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.262273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.262952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.296667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:02.298176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.335919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.336590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.336969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.337134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.337843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.340081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.383884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 908/1812] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:02.391967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 905/1813] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:02.397116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.403917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.405802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.421621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbe38f-f4b6-4490-9f8b-faddfdcb4253 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.536352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8a31-2302-4af7-95ee-7d3137f74c4b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.539182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d422db0-59ba-4996-b76e-a514df252853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.539907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d422db0-59ba-4996-b76e-a514df252853 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.540192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d422db0-59ba-4996-b76e-a514df252853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.540520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d422db0-59ba-4996-b76e-a514df252853 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.541229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d422db0-59ba-4996-b76e-a514df252853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.543962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1741c1-85fd-41b6-be16-649892598e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.544239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d422db0-59ba-4996-b76e-a514df252853 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.545048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1741c1-85fd-41b6-be16-649892598e01 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.546700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1741c1-85fd-41b6-be16-649892598e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.548476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1741c1-85fd-41b6-be16-649892598e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.568724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1741c1-85fd-41b6-be16-649892598e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.571177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1741c1-85fd-41b6-be16-649892598e01 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.585051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 906/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:02.586837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b60a4c-e53c-45b3-a4e0-824039039c1c None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.587371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b60a4c-e53c-45b3-a4e0-824039039c1c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.587847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b60a4c-e53c-45b3-a4e0-824039039c1c None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.589894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 907/1815] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:15:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:15:02.591080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 909/1816] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:02.594698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b60a4c-e53c-45b3-a4e0-824039039c1c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.615706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b60a4c-e53c-45b3-a4e0-824039039c1c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.622152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.623448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.625247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62f03-9434-452b-912d-9ec4c2ce0827 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.625742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62f03-9434-452b-912d-9ec4c2ce0827 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.626733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62f03-9434-452b-912d-9ec4c2ce0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.632156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.633965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.636449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.639107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.652999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-eaa62f03-9434-452b-912d-9ec4c2ce0827 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:02.653760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eaa62f03-9434-452b-912d-9ec4c2ce0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.654616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 908/1817] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:02.655724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.703791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1304-c524-482b-9932-4cd21a36c04e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.723395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.724083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.724365 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.724808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.725697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.727628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.753855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 909/1818] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:02.756182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.767084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 910/1819] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:02.769301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb29ff-5daa-4bd5-8b76-6c846c123efa admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:02.776433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:02.777526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.777818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.778221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] PATH_INFO: `/v3/projects/49233ae3a68f420cba359c8e07508043/users/2cdfd6499f694faf9ee490825ce7d024/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.800125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49233ae3a68f420cba359c8e07508043, user_id=2cdfd6499f694faf9ee490825ce7d024, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:02.803740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:02.823183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 910/1820] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:02 2021] PUT /identity/v3/projects/49233ae3a68f420cba359c8e07508043/users/2cdfd6499f694faf9ee490825ce7d024/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:02.834955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006e40-a94b-4f3c-9788-94fa35783889 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.839356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006e40-a94b-4f3c-9788-94fa35783889 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.839675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006e40-a94b-4f3c-9788-94fa35783889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:02.885200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-de006e40-a94b-4f3c-9788-94fa35783889 None None] MFA Rules not processed for user `2cdfd6499f694faf9ee490825ce7d024`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:02.886473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-de006e40-a94b-4f3c-9788-94fa35783889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:02.957599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 911/1821] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:02.963096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:02.987540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:02.988531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:02.988531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.010477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] MFA Rules not processed for user `107444106cda461dab7c403665d92613`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:03.011860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.094701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c31d8-8462-415a-a40d-6c04e946682c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:03.104041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 912/1822] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:03.114453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:03.115572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.115572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.115762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.116952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:03.118900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:03.159128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 911/1823] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:02 2021] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:03.163420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.175111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866d94-83b0-4b67-ac9a-0d7cd3584e47 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:03.217682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.219997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.304474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:03.315225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.316461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.318017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.318940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:03.329891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:03.365002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990166-5472-4b81-9327-6e5c656f7b73 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:03.375790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:03.377289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.378120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.378626 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] PATH_INFO: `/v3/projects/77fa1b12905b450f870fbf2ff3b9299b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.381214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fa1b12905b450f870fbf2ff3b9299b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:03.383770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:03.390204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 913/1824] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:03 2021] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:03.391118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.394516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.478438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fa1b12905b450f870fbf2ff3b9299b', 'request_id': 'req-cc7e0744-a4a7-4ede-b43c-da4314395163'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.494657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fa1b12905b450f870fbf2ff3b9299b', 'request_id': 'req-cc7e0744-a4a7-4ede-b43c-da4314395163'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.512733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fa1b12905b450f870fbf2ff3b9299b', 'request_id': 'req-cc7e0744-a4a7-4ede-b43c-da4314395163'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.534711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] The token cache is being invalidate because project 77fa1b12905b450f870fbf2ff3b9299b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:03.535098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.535927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.544868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 912/1825] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:03 2021] DELETE /identity/v3/projects/77fa1b12905b450f870fbf2ff3b9299b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:03.544868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.545168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98be4f-875e-4f52-8992-7f8db36225e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:03.545931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.627960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:03.628803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.629271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.630315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.632144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.648086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:03.650209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:03.662831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 914/1826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:03.663835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.665823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.685904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0744-a4a7-4ede-b43c-da4314395163 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:03.687948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52d71-6a4a-4342-b997-c0d9e42b36ab service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:03.698309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfaa5b-8193-432d-870b-4deb97e677d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:03.699332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfaa5b-8193-432d-870b-4deb97e677d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.700283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfaa5b-8193-432d-870b-4deb97e677d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.700830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfaa5b-8193-432d-870b-4deb97e677d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.702253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfaa5b-8193-432d-870b-4deb97e677d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:03.704590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfaa5b-8193-432d-870b-4deb97e677d4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:03.708675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:03.709700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.711293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.713139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] PATH_INFO: `/v3/projects/164f0ca19b984eebb1c8f272ac74a98a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.716070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=164f0ca19b984eebb1c8f272ac74a98a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:03.719934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:03.741869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 915/1827] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:03.743433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951087d6-b358-4202-99c0-f34eead169ea None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:03.744003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951087d6-b358-4202-99c0-f34eead169ea None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:03.744121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951087d6-b358-4202-99c0-f34eead169ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:03.814174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164f0ca19b984eebb1c8f272ac74a98a', 'request_id': 'req-4fde5aa4-3773-45bb-b658-b769bce02aca'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.822159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164f0ca19b984eebb1c8f272ac74a98a', 'request_id': 'req-4fde5aa4-3773-45bb-b658-b769bce02aca'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.825873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-951087d6-b358-4202-99c0-f34eead169ea None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:03.831554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-951087d6-b358-4202-99c0-f34eead169ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.835490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164f0ca19b984eebb1c8f272ac74a98a', 'request_id': 'req-4fde5aa4-3773-45bb-b658-b769bce02aca'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.851893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] The token cache is being invalidate because project 164f0ca19b984eebb1c8f272ac74a98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:03.852455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.853294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:03.856611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 913/1828] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:03 2021] DELETE /identity/v3/projects/164f0ca19b984eebb1c8f272ac74a98a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:03.858383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.860758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:03.979946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 916/1829] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:03.980821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951087d6-b358-4202-99c0-f34eead169ea None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:03.991872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-951087d6-b358-4202-99c0-f34eead169ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.013687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5aa4-3773-45bb-b658-b769bce02aca admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.021364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716ea8-866f-4482-b010-110e5e57d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.022325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716ea8-866f-4482-b010-110e5e57d625 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.022607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716ea8-866f-4482-b010-110e5e57d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.022883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716ea8-866f-4482-b010-110e5e57d625 admin admin] PATH_INFO: `/v3/projects/ff787537d2f74d22b0ae8cded764ac3a/users/26bd9f657b1e4c3ab2100499df8be355/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.024085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951087d6-b358-4202-99c0-f34eead169ea None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.038096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.038980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.039285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.041707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] PATH_INFO: `/v3/users/b736eb5bdf8449688ca63d82c71c28ef` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.046562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b736eb5bdf8449688ca63d82c71c28ef)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.048517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.064463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47716ea8-866f-4482-b010-110e5e57d625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff787537d2f74d22b0ae8cded764ac3a, user_id=26bd9f657b1e4c3ab2100499df8be355, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.069727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47716ea8-866f-4482-b010-110e5e57d625 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.093860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 914/1830] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:03 2021] PUT /identity/v3/projects/ff787537d2f74d22b0ae8cded764ac3a/users/26bd9f657b1e4c3ab2100499df8be355/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:04.095878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.096163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.096439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.156656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b736eb5bdf8449688ca63d82c71c28ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.172995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b736eb5bdf8449688ca63d82c71c28ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.173870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b736eb5bdf8449688ca63d82c71c28ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.206001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b736eb5bdf8449688ca63d82c71c28ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.224234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b736eb5bdf8449688ca63d82c71c28ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.231423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 917/1831] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:03 2021] DELETE /identity/v3/users/b736eb5bdf8449688ca63d82c71c28ef => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:04.234899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:04.241118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.347504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:04.349393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.385242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d181d-a1fc-4196-a2b6-c03550e3f9e3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.392072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.393117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.393414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.393748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.396240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.399533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.419546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 918/1832] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:04 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:04.422252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:04.433667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bc0d5-f4eb-4acd-a660-633c042ebfaa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.438750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4cb88-00db-4671-9669-9fb666309cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.439683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4cb88-00db-4671-9669-9fb666309cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.439963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4cb88-00db-4671-9669-9fb666309cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.440237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4cb88-00db-4671-9669-9fb666309cd8 admin admin] PATH_INFO: `/v3/projects/ff787537d2f74d22b0ae8cded764ac3a/users/26bd9f657b1e4c3ab2100499df8be355/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.441468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 915/1833] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:04.443410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4cb88-00db-4671-9669-9fb666309cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff787537d2f74d22b0ae8cded764ac3a, user_id=26bd9f657b1e4c3ab2100499df8be355, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.445903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4cb88-00db-4671-9669-9fb666309cd8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.447491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:04.460343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de4416-0717-4aa3-b22b-6397f64ab9c1 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.461008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 919/1834] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:04 2021] PUT /identity/v3/projects/ff787537d2f74d22b0ae8cded764ac3a/users/26bd9f657b1e4c3ab2100499df8be355/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:04.472392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.472731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.472922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.524795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] MFA Rules not processed for user `26bd9f657b1e4c3ab2100499df8be355`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:04.526466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.602742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.603454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.604120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.604408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.607074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:04.607459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.607968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 920/1835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:04 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:04.609278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.619291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:04.620871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.649640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 916/1836] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:15:04.650649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:04.653655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.680710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d5ce-4c40-4c05-a39a-e03575305fa1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.688695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.690446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.690807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.691158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] PATH_INFO: `/v3/projects/b5224adb55d5434aa97c0cbffb14693e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.692975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5224adb55d5434aa97c0cbffb14693e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.696798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.705254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336369b-87d7-4974-a56f-5f98e6600fc8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.709820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.710464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.710745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.711021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.724821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.726615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:04.752127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5224adb55d5434aa97c0cbffb14693e', 'request_id': 'req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.755278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 921/1837] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:04 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:04.763767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:04.765673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5224adb55d5434aa97c0cbffb14693e', 'request_id': 'req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.776817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5224adb55d5434aa97c0cbffb14693e', 'request_id': 'req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.793520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] The token cache is being invalidate because project b5224adb55d5434aa97c0cbffb14693e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:04.794221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.795172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a3bf0bc4-c17a-40ab-bfcf-2e61a1c3e240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:04.798778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db9c6-e5a6-4c29-a301-331ced319431 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:04.813722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 917/1838] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:04 2021] DELETE /identity/v3/projects/b5224adb55d5434aa97c0cbffb14693e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:04.827592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca50ef-3473-4f48-91ee-5cd75bf9e516 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.827905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca50ef-3473-4f48-91ee-5cd75bf9e516 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.828334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca50ef-3473-4f48-91ee-5cd75bf9e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.880953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2aca50ef-3473-4f48-91ee-5cd75bf9e516 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:04.882185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2aca50ef-3473-4f48-91ee-5cd75bf9e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:04.986703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:04.989034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:04.989658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:04.989658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:04.990419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:04.992746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.021261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 918/1839] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:05.022651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.022978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.023285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.079725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 922/1840] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:04 2021] POST /identity/v3/projects => generated 407 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:05.079725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.080046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:05.080046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.080219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.185437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 919/1841] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:05.187967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.191244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.205562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60560995-9fd5-48e9-aafc-6b3761148a9a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.209675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6edc1d-b79d-410a-8f12-0733a4d45ee9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.214659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.215444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.215878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.216309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.217091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.219125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.220936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.220936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.220936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.221216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] PATH_INFO: `/v3/users/2cdfd6499f694faf9ee490825ce7d024` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.228338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdfd6499f694faf9ee490825ce7d024)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.231382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.256468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 920/1842] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:05 2021] POST /identity/v3/users => generated 304 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:05.257333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.268022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f2b23-6944-4284-af80-4bccfe3e2a54 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.272859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.273766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.273766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.274245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.275252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:05.275584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.277121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.298872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 921/1843] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:05.300852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.321254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3590-85fa-40ef-97ef-daa738b9802a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.329062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.329905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.330152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdfd6499f694faf9ee490825ce7d024'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:05.330594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.331017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.331799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.333759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.338799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdfd6499f694faf9ee490825ce7d024'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:05.339995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdfd6499f694faf9ee490825ce7d024'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:05.345536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 922/1844] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:05.346916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.351655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.357538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdfd6499f694faf9ee490825ce7d024'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:05.371202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdfd6499f694faf9ee490825ce7d024'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:05.378892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203335e-2a61-42e9-9892-8eab66476d61 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.389039 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d4b0-77e5-4839-b3c9-a9ab17d890b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.390752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d4b0-77e5-4839-b3c9-a9ab17d890b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.391065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d4b0-77e5-4839-b3c9-a9ab17d890b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.402496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 923/1845] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:05 2021] DELETE /identity/v3/users/2cdfd6499f694faf9ee490825ce7d024 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:05.402496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.405349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d4b0-77e5-4839-b3c9-a9ab17d890b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.406002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d4b0-77e5-4839-b3c9-a9ab17d890b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.407487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.409897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d4b0-77e5-4839-b3c9-a9ab17d890b4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.471353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 923/1846] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:05 2021] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:05.473397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.473932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.474570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.501336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:05.503899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.556704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d04ca2-4803-46c6-bf77-de7debc12cf7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.659096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 924/1847] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:05.659096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.681658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea0879-cd4a-435f-901f-691bb585401a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.688448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.689381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.689982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.690142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.691342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.694167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.719762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.720688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.720976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.721256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.722006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.725119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.743922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 924/1848] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:05.744678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.749002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 925/1849] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:05 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:05.750235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.751613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:05.775409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217d80-b76b-433c-822f-9518fdc1354c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.790390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.791386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.791573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.791848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] PATH_INFO: `/v3/projects/8bfddaaf2c8d4e40a54376f425c6f222/users/7bf53443ecfa43e3b1d5910a3be15276/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.818548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfddaaf2c8d4e40a54376f425c6f222, user_id=7bf53443ecfa43e3b1d5910a3be15276, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.822647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.846667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 926/1850] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:05 2021] PUT /identity/v3/projects/8bfddaaf2c8d4e40a54376f425c6f222/users/7bf53443ecfa43e3b1d5910a3be15276/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:05.848097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:05.848805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd15c69-b4c3-40e2-a2c5-33b57d93d138 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.950664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.952210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.952696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.953310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.954459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8016efa-afaf-497f-a003-a0ddf6cfa45c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:05.960584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f7be-5d6c-49e4-8f3b-60ebb3eaa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:05.961330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f7be-5d6c-49e4-8f3b-60ebb3eaa258 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.961608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f7be-5d6c-49e4-8f3b-60ebb3eaa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.961956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f7be-5d6c-49e4-8f3b-60ebb3eaa258 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.962908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f7be-5d6c-49e4-8f3b-60ebb3eaa258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.964912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f7be-5d6c-49e4-8f3b-60ebb3eaa258 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.969714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:05.971303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:05.978679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 927/1851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:05.980917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:05.981855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:05.982142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:05.993092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 925/1852] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:05.994218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.007515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202173-80ac-41ad-ab00-0ac07ee7b3c3 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.015920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.016789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.018092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.018092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.019368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.023950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.040745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 926/1853] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:06.046557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.047927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] MFA Rules not processed for user `7bf53443ecfa43e3b1d5910a3be15276`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:06.049037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:06.075751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6013c-82db-4a4c-9234-3e37406765e4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.083885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5d07-c322-4e2c-9848-bf8d1b957b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.085568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5d07-c322-4e2c-9848-bf8d1b957b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.086414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5d07-c322-4e2c-9848-bf8d1b957b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.086875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5d07-c322-4e2c-9848-bf8d1b957b18 admin admin] PATH_INFO: `/v3/projects/34bdb3e9f90b4eb3a1dc5bc599d894e3/users/0ef54cadbfb24be88ebcb8156293300e/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.110933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5d07-c322-4e2c-9848-bf8d1b957b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bdb3e9f90b4eb3a1dc5bc599d894e3, user_id=0ef54cadbfb24be88ebcb8156293300e, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.116297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5d07-c322-4e2c-9848-bf8d1b957b18 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.153182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 927/1854] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:06 2021] PUT /identity/v3/projects/34bdb3e9f90b4eb3a1dc5bc599d894e3/users/0ef54cadbfb24be88ebcb8156293300e/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:06.154775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.155138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.155740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.173649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 928/1855] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:05 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:06.178458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.190404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6154fd-f2e6-43b9-8b4c-a15aa7d4b68c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.192845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] MFA Rules not processed for user `0ef54cadbfb24be88ebcb8156293300e`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:06.194425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:06.281263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 928/1856] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:06.302840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.306703 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.307923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.308408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.308700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.309419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.311643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.313535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:06.368196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 929/1857] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:06 2021] POST /identity/v3/projects => generated 409 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:06.371024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.423034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97dc0-d2c1-4403-8c5a-01a41facfc39 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.466649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ed982-b04e-4fe3-884f-14f1d93a6d7c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.472548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.475118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.475640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.476252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.477167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.479665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.493979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.494825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.495314 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.495749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.523111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 930/1858] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:06 2021] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:06.524165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.537298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3db7b-2986-491d-b5fb-c95d5ca9c783 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.543346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.544110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.544441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.544666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.547431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.550484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.568402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 931/1859] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:06.570548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.586333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619767a5-0f37-41c9-a28e-fa1d32766080 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.593406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.594755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.595058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.595347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] PATH_INFO: `/v3/projects/e51acd9b757d4579ad184fd39ab89232/users/9e11120c64774b018dff3d1f7d45790e/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.617458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51acd9b757d4579ad184fd39ab89232, user_id=9e11120c64774b018dff3d1f7d45790e, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.621650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.626747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.631780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.655404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 932/1860] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:06 2021] PUT /identity/v3/projects/e51acd9b757d4579ad184fd39ab89232/users/9e11120c64774b018dff3d1f7d45790e/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:06.660503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.666117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:06.671015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 929/1861] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:06.672002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.717872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea92941-c5a0-4e74-8b1b-b876a2e7f066 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.836367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377f29f-62b0-4743-968f-b88aaa462608 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.844674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.845786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.845996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.846264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] PATH_INFO: `/v3/projects/49233ae3a68f420cba359c8e07508043` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.847530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49233ae3a68f420cba359c8e07508043)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.850133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.902569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:06.903189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:06.905996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:06.906332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:06.907197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:06.908832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:06.931239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 930/1862] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:06.932574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:06.947145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49233ae3a68f420cba359c8e07508043', 'request_id': 'req-aca475c4-812b-4799-9b0f-2fe9f53ee653'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:06.954124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49233ae3a68f420cba359c8e07508043', 'request_id': 'req-aca475c4-812b-4799-9b0f-2fe9f53ee653'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:06.971789 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49233ae3a68f420cba359c8e07508043', 'request_id': 'req-aca475c4-812b-4799-9b0f-2fe9f53ee653'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:06.976664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b209-9b73-4894-8994-76732e54377d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:06.991428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] The token cache is being invalidate because project 49233ae3a68f420cba359c8e07508043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:06.991690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:06.992351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:06.995082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 933/1863] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:06 2021] DELETE /identity/v3/projects/49233ae3a68f420cba359c8e07508043 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:06.995082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:07.001255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.056060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:07.056722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.056953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.057233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] PATH_INFO: `/v3/users/0ef54cadbfb24be88ebcb8156293300e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.058563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef54cadbfb24be88ebcb8156293300e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:07.060596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:07.103300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca475c4-812b-4799-9b0f-2fe9f53ee653 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:07.112605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:07.114760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.115071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.115354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] PATH_INFO: `/v3/projects/e51acd9b757d4579ad184fd39ab89232/users/9e11120c64774b018dff3d1f7d45790e/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.117564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51acd9b757d4579ad184fd39ab89232, user_id=9e11120c64774b018dff3d1f7d45790e, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:07.120242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:07.128114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef54cadbfb24be88ebcb8156293300e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.137071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 934/1864] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:06 2021] PUT /identity/v3/projects/e51acd9b757d4579ad184fd39ab89232/users/9e11120c64774b018dff3d1f7d45790e/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:07.149487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef54cadbfb24be88ebcb8156293300e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.149985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:07.149985 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.150230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef54cadbfb24be88ebcb8156293300e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.168633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef54cadbfb24be88ebcb8156293300e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.180301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a2c7d7a-8999-4096-b9c2-6c8989c671b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef54cadbfb24be88ebcb8156293300e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.189055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 931/1865] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:06 2021] DELETE /identity/v3/users/0ef54cadbfb24be88ebcb8156293300e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:07.195443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.195733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.196016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.227618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] MFA Rules not processed for user `9e11120c64774b018dff3d1f7d45790e`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:07.229001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.247925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c18ff-ab6c-470f-80e7-a5cb1d441477 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:07.318454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 932/1866] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:07 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:07.319184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:07.320867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.367421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:07.368298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.368572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.368847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] PATH_INFO: `/v3/users/26bd9f657b1e4c3ab2100499df8be355` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.372079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bd9f657b1e4c3ab2100499df8be355)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:07.378342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:07.468399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708dc6-f5b4-44d3-8515-93d734da9b08 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:07.473711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:07.474359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.474954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.475260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] PATH_INFO: `/v3/users/ced4757619774002be4e6b3e6ec8736b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.476023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bd9f657b1e4c3ab2100499df8be355'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.477538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced4757619774002be4e6b3e6ec8736b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:07.478304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bd9f657b1e4c3ab2100499df8be355'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.479497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:07.508763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bd9f657b1e4c3ab2100499df8be355'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.510188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bd9f657b1e4c3ab2100499df8be355'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.528202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a0b7ef9-0332-492c-ab00-5fde5ee02432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bd9f657b1e4c3ab2100499df8be355'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.562264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 935/1867] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:07 2021] DELETE /identity/v3/users/26bd9f657b1e4c3ab2100499df8be355 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:07.564073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e073ea9-699c-49b2-8b0f-3efcd53a3c9f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.564882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e073ea9-699c-49b2-8b0f-3efcd53a3c9f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.565708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e073ea9-699c-49b2-8b0f-3efcd53a3c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.566707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced4757619774002be4e6b3e6ec8736b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.583666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced4757619774002be4e6b3e6ec8736b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.584440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced4757619774002be4e6b3e6ec8736b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.591311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5e073ea9-699c-49b2-8b0f-3efcd53a3c9f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:07.599224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5e073ea9-699c-49b2-8b0f-3efcd53a3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.604890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced4757619774002be4e6b3e6ec8736b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.615179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced4757619774002be4e6b3e6ec8736b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:07.634542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 933/1868] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:07 2021] DELETE /identity/v3/users/ced4757619774002be4e6b3e6ec8736b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:07.634542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:07.635915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.720866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 936/1869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:07.722243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.722526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.722807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.780314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:07.782686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.798345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e578-17e4-4f30-b7ae-79b2022476b9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:07.805816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:07.806712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.806995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.807388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:07.809685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.883066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 937/1870] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:07.883066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:07.888999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:07.974527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cede3a-1607-4954-85af-9b4a8b07e674 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:07.982084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:07.983153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:07.983441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:07.983873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.002363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:08.005387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:08.019273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 938/1871] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:08.019877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:08.020462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:08.021433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:08.033287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18532e8-17ae-4f9c-8c79-99e2564cb3b2 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:08.039913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:08.040965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.041501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.041776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.054751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:08.056916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:08.057497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 934/1872] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:07 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:08.069577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 939/1873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:08.336137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:08.347843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566661-3817-4165-8c8b-66851ea5b29b service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:08.356178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:08.356983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.357268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.358128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.362937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:08.425997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:08.428925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:08.447505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb668-b9ca-4b01-9d5c-a568f8e08e8d service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:08.448921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:08.450411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24101f-210e-473d-ac2c-47b24c2b6e78 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:08.461727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 935/1874] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:08 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:08.463143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f4d0f-7a33-4f76-b404-96e0886b45f7 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.463418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f4d0f-7a33-4f76-b404-96e0886b45f7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.463698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f4d0f-7a33-4f76-b404-96e0886b45f7 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.467874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 936/1875] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:15:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:15:08.476200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:08.477678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440b37-dd09-40d7-800c-cdb62e4b4b46 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.477973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440b37-dd09-40d7-800c-cdb62e4b4b46 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.478251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440b37-dd09-40d7-800c-cdb62e4b4b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.479754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.482096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.485991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] PATH_INFO: `/v3/projects/ff787537d2f74d22b0ae8cded764ac3a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.490727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff787537d2f74d22b0ae8cded764ac3a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:08.495739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:08.530921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e2440b37-dd09-40d7-800c-cdb62e4b4b46 None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:08.532315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e2440b37-dd09-40d7-800c-cdb62e4b4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:08.639842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff787537d2f74d22b0ae8cded764ac3a', 'request_id': 'req-4490a433-f0d8-42e5-8ac5-a91999228b77'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:08.657723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff787537d2f74d22b0ae8cded764ac3a', 'request_id': 'req-4490a433-f0d8-42e5-8ac5-a91999228b77'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:08.678214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff787537d2f74d22b0ae8cded764ac3a', 'request_id': 'req-4490a433-f0d8-42e5-8ac5-a91999228b77'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:08.679441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 937/1876] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:15:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:08.698257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] The token cache is being invalidate because project ff787537d2f74d22b0ae8cded764ac3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:08.698895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:08.701099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:08.705185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 940/1877] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:08 2021] DELETE /identity/v3/projects/ff787537d2f74d22b0ae8cded764ac3a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:08.710987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a90c2-d148-4744-9519-d8ee233ff4ba None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.710987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a90c2-d148-4744-9519-d8ee233ff4ba None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.711174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a90c2-d148-4744-9519-d8ee233ff4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.756135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0b3a90c2-d148-4744-9519-d8ee233ff4ba None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:08.759888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0b3a90c2-d148-4744-9519-d8ee233ff4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:08.876201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:08.878145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:08.911079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 938/1878] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:08.918075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.918509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.918678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.955637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:08.956867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:08.966516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 939/1879] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:08.971882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:08.985139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f40e5c-3afe-4712-88e5-971806975baf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:08.996528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:08.997732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:08.998280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:08.998733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:08.999671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:09.000102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.001988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.021079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a433-f0d8-42e5-8ac5-a91999228b77 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.021899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 940/1880] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:09.023141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.031130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.031856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.032143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.032799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.035202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:09.035536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666c165-c8bd-4a05-894c-70c650645fd2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.047941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.049019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.049928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.050477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.051227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.052656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.053562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.056571 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.068145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 941/1881] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:09.121067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 941/1882] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:09 2021] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:09.125243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.139033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77dc48-88d8-4dfc-9fce-7881bd8d721f service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.243556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.244717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.245407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.245830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.246734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.249055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.278930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 942/1883] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:09 2021] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:09.283107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.297000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ead5-3cf9-4d7c-918a-8c31504e3329 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.304217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.305539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.306066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.306560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.307592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.311637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.331677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 942/1884] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:09 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:09.336631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.373957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796eecb-c53b-48b1-8b8d-b5f2ef5d3ad5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.381824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670fe4-366a-406e-9f2f-948ee7c5604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.382839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670fe4-366a-406e-9f2f-948ee7c5604b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.383175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670fe4-366a-406e-9f2f-948ee7c5604b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.383494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670fe4-366a-406e-9f2f-948ee7c5604b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.384774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c670fe4-366a-406e-9f2f-948ee7c5604b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.386448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c670fe4-366a-406e-9f2f-948ee7c5604b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.407947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 943/1885] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:09 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:09.412272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.425320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36624d64-c56d-4db7-92d3-2065f18ddc30 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.432604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.434188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.434477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.434752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] PATH_INFO: `/v3/projects/1d3ef270d65d474f9150f140a3767576/users/54389a788c234ee0be611b8fe7406900/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.455174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3ef270d65d474f9150f140a3767576, user_id=54389a788c234ee0be611b8fe7406900, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.459275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.479849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 943/1886] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:09 2021] PUT /identity/v3/projects/1d3ef270d65d474f9150f140a3767576/users/54389a788c234ee0be611b8fe7406900/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:09.484771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.485113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.485400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.505354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:09.506793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:09.588303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 944/1887] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:09.604866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.606719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:09.684877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.686449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:09.709259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e988-b2cc-4f86-ad7c-27431fd3854b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.723139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.724856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.725170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.725479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] PATH_INFO: `/v3/projects/34bdb3e9f90b4eb3a1dc5bc599d894e3` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.728012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bdb3e9f90b4eb3a1dc5bc599d894e3)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.731692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738b34b-7306-4e4e-b9ae-cac6f09d89a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.733175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.739685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:09.740187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.740472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.740761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.767005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:09.768667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:09.793788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 944/1888] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:09.794815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:09.797850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:09.833895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6ecb-6316-45b4-9eaf-21e0c3949cfc service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:09.847503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bdb3e9f90b4eb3a1dc5bc599d894e3', 'request_id': 'req-b70e997f-76d0-4408-a1a3-694ace01fc00'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:09.858569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bdb3e9f90b4eb3a1dc5bc599d894e3', 'request_id': 'req-b70e997f-76d0-4408-a1a3-694ace01fc00'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:09.871539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bdb3e9f90b4eb3a1dc5bc599d894e3', 'request_id': 'req-b70e997f-76d0-4408-a1a3-694ace01fc00'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:09.892567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] The token cache is being invalidate because project 34bdb3e9f90b4eb3a1dc5bc599d894e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:09.892991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:09.893819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b70e997f-76d0-4408-a1a3-694ace01fc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:09.902307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 945/1889] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:09 2021] DELETE /identity/v3/projects/34bdb3e9f90b4eb3a1dc5bc599d894e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:09.904524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a9f0-6818-4c24-a891-1b4282e6ae1e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:09.904827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a9f0-6818-4c24-a891-1b4282e6ae1e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:09.905292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a9f0-6818-4c24-a891-1b4282e6ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:09.934530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e4a7a9f0-6818-4c24-a891-1b4282e6ae1e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:09.936183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e4a7a9f0-6818-4c24-a891-1b4282e6ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:10.002075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.004196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.005895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.006413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] PATH_INFO: `/v3/projects/28dd72787d9244a9af4e958909347b5c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.008219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dd72787d9244a9af4e958909347b5c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.010469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.030201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 946/1890] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:10.039245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.039532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.040283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.063121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:10.064400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:10.083391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 947/1891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:10.095122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.106065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dd72787d9244a9af4e958909347b5c', 'request_id': 'req-f2744273-3e4f-4c93-9916-3a4ad0230a13'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.122161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dd72787d9244a9af4e958909347b5c', 'request_id': 'req-f2744273-3e4f-4c93-9916-3a4ad0230a13'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.135176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cfbd7-b3ac-4438-a236-6f52e0fe4867 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.141137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dd72787d9244a9af4e958909347b5c', 'request_id': 'req-f2744273-3e4f-4c93-9916-3a4ad0230a13'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.157448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] The token cache is being invalidate because project 28dd72787d9244a9af4e958909347b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:10.158321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.159450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.162117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 945/1892] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:09 2021] DELETE /identity/v3/projects/28dd72787d9244a9af4e958909347b5c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:10.166829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.176947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:10.266804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.267829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.269481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.269721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.271765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:10.272075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.274357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.292779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2744273-3e4f-4c93-9916-3a4ad0230a13 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.304769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 948/1893] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:10.306123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.308017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.308550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.308834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.309105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] PATH_INFO: `/v3/users/1010f395a1f248d7ba75fce266ec6226` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.311026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1010f395a1f248d7ba75fce266ec6226)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.313377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.315899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:10.338771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ddde-28fb-4fd0-9db1-9451d241e43e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.353234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.353907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.354288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.354564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.355370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.359117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.408651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 949/1894] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:10 2021] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:10.412743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.419726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1010f395a1f248d7ba75fce266ec6226'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.428065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1010f395a1f248d7ba75fce266ec6226'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.430375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1010f395a1f248d7ba75fce266ec6226'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.462706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1010f395a1f248d7ba75fce266ec6226'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.487998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1010f395a1f248d7ba75fce266ec6226'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:10.498442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 946/1895] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:10 2021] DELETE /identity/v3/users/1010f395a1f248d7ba75fce266ec6226 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:10.532326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891582f2-02e1-48fc-b922-98ac22323215 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.652234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.653055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.653526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.653710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.659157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.659157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.699566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.700975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:10.702593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 950/1896] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:10 2021] POST /identity/v3/users => generated 281 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:10.719803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652356-6ae8-45bd-966d-d825e40cc267 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.730539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.731290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.731578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.731853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.733535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.737901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.756927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 947/1897] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:10 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:10.762323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.774829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba494-3a5c-4f71-ae3e-afd3bab1c21a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.779701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7f6d6-9438-40e8-9006-c135568f3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.780377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f6d6-9438-40e8-9006-c135568f3f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.780654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f6d6-9438-40e8-9006-c135568f3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.780966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f6d6-9438-40e8-9006-c135568f3f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.781666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7f6d6-9438-40e8-9006-c135568f3f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.783584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7f6d6-9438-40e8-9006-c135568f3f1d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.796594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 951/1898] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:10.800921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:10.823603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c221-d219-4555-a643-dfb714aa3cb6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:10.829896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:10.831156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.831594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.831880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] PATH_INFO: `/v3/projects/8ea9e693a4ab44fda25efd775330b000/users/3c7ddb6222324dcd9efa9b850f4ad922/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.853719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea9e693a4ab44fda25efd775330b000, user_id=3c7ddb6222324dcd9efa9b850f4ad922, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:10.858520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:10.900493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 948/1899] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:10 2021] PUT /identity/v3/projects/8ea9e693a4ab44fda25efd775330b000/users/3c7ddb6222324dcd9efa9b850f4ad922/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:10.903154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:10.903455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:10.904211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:10.937979 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] MFA Rules not processed for user `3c7ddb6222324dcd9efa9b850f4ad922`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:10.939378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.035566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 952/1900] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:10 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:11.066166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.067932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.140159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab541fb6-d18d-4b5a-bb8e-a2e12f9de1a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.148544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd087-a7fa-4ff2-93cb-6836c3292c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.149339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd087-a7fa-4ff2-93cb-6836c3292c92 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.150582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd087-a7fa-4ff2-93cb-6836c3292c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.150872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd087-a7fa-4ff2-93cb-6836c3292c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.163000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fd087-a7fa-4ff2-93cb-6836c3292c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.164449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fd087-a7fa-4ff2-93cb-6836c3292c92 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.169104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.170874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.221141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 949/1901] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:11 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:11.224500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673055-e042-4548-b76d-361813c16278 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.224783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673055-e042-4548-b76d-361813c16278 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.225059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673055-e042-4548-b76d-361813c16278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.287805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cb673055-e042-4548-b76d-361813c16278 None None] MFA Rules not processed for user `54389a788c234ee0be611b8fe7406900`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:11.289126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cb673055-e042-4548-b76d-361813c16278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.304408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9498-978c-43c9-836c-447d1d8e277b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.310404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.311705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.312138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.312554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] PATH_INFO: `/v3/projects/d6d9f7a3ebd14c04906ac8a38ec42975` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.313963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d9f7a3ebd14c04906ac8a38ec42975)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.316238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.407562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d9f7a3ebd14c04906ac8a38ec42975', 'request_id': 'req-7e77716b-f599-4ae8-8b08-85f097432662'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.416299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d9f7a3ebd14c04906ac8a38ec42975', 'request_id': 'req-7e77716b-f599-4ae8-8b08-85f097432662'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.434338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 950/1902] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:11.435376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673055-e042-4548-b76d-361813c16278 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.438656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d9f7a3ebd14c04906ac8a38ec42975', 'request_id': 'req-7e77716b-f599-4ae8-8b08-85f097432662'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.448782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673055-e042-4548-b76d-361813c16278 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.456934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] The token cache is being invalidate because project d6d9f7a3ebd14c04906ac8a38ec42975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:11.456934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.458224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.464367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 953/1903] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:11 2021] DELETE /identity/v3/projects/d6d9f7a3ebd14c04906ac8a38ec42975 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:11.465308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.466837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.534575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.535725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.536176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.536610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] PATH_INFO: `/v3/users/3c7ddb6222324dcd9efa9b850f4ad922` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.538123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7ddb6222324dcd9efa9b850f4ad922)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.540457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.559679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77716b-f599-4ae8-8b08-85f097432662 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.569999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736652f-715d-49cd-8efe-0409db75d5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.570717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736652f-715d-49cd-8efe-0409db75d5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.572083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736652f-715d-49cd-8efe-0409db75d5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.572786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736652f-715d-49cd-8efe-0409db75d5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.574628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736652f-715d-49cd-8efe-0409db75d5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.578485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736652f-715d-49cd-8efe-0409db75d5f6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.625671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7ddb6222324dcd9efa9b850f4ad922'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.635655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7ddb6222324dcd9efa9b850f4ad922'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.637202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7ddb6222324dcd9efa9b850f4ad922'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.645630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 954/1904] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:11.645630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9d61f-c79d-4de7-9191-0b712214bdb3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.645630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9d61f-c79d-4de7-9191-0b712214bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.645630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9d61f-c79d-4de7-9191-0b712214bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.671799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7ddb6222324dcd9efa9b850f4ad922'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.671957 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-45c9d61f-c79d-4de7-9191-0b712214bdb3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:11.673253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-45c9d61f-c79d-4de7-9191-0b712214bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.692479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7ddb6222324dcd9efa9b850f4ad922'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:11.707348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 951/1905] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:11 2021] DELETE /identity/v3/users/3c7ddb6222324dcd9efa9b850f4ad922 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:11.707348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.707928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.777699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 955/1906] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:11.787479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56216cc-69ea-4aa9-948a-8696823a0fe5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.787781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56216cc-69ea-4aa9-948a-8696823a0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.788573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56216cc-69ea-4aa9-948a-8696823a0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.803839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350b241-b7cb-4618-89f5-8f4fd747260d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.807517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b56216cc-69ea-4aa9-948a-8696823a0fe5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:11.808843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b56216cc-69ea-4aa9-948a-8696823a0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.808979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.809739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.810183 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.810805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.811587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.813925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.820473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 956/1907] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:11.823635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.823635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.824379 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.848940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 952/1908] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:11.850076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.852070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.853400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:11.854636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:11.875140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 957/1909] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:11.875853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.886438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c350f3-102d-437a-97ec-e6a5298f4879 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.891267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.891925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.892206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.892468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.893205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.894796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.905890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 958/1910] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:11.906917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.916840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6e59-dd35-4d9a-99a3-e31a5916a8c1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.920445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039425a2-3f17-44d1-9583-df051e61ead0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.921591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.922283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.922652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.922996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.923751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:11.924056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.924225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.924853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.927204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.931440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.932025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.941533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 959/1911] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:11.942856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.946521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.948080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.952856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243cf6-7e77-4423-98a2-9f3c239c3f2e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.957555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.957686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 953/1912] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:11.958512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:11.958638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.959055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.959408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] PATH_INFO: `/v3/projects/4e2b5edb1bd448aa8072acfc47c23e9a/users/3b5127fab25e4848bfcd59cb26d36bad/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.967698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979f88-76cb-44a0-afdc-b9f278f7b33e service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:11.974708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2b5edb1bd448aa8072acfc47c23e9a, user_id=3b5127fab25e4848bfcd59cb26d36bad, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.975324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:11.976056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:11.976398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:11.976730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:11.977491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:11.977910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.979511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:11.997504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 960/1913] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:11 2021] PUT /identity/v3/projects/4e2b5edb1bd448aa8072acfc47c23e9a/users/3b5127fab25e4848bfcd59cb26d36bad/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:12.001976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.028668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 954/1914] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:11 2021] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:12.030515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.083348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec44a5-46a8-44ff-adf0-192db0f6883a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.155466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba41d-f99e-4de5-9f3e-a29923adc541 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.162083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.162757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.163055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.163300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.163427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.164159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.164543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.164651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.164988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.166186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.166606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.168250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.183275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 961/1915] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:12.187455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.200404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65e2c0-cc00-4504-8208-5ea1c5603e8f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.205607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 955/1916] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:12.206768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.208778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.208930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.209321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] PATH_INFO: `/v3/projects/4e2b5edb1bd448aa8072acfc47c23e9a/users/3b5127fab25e4848bfcd59cb26d36bad/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.209923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.212014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2b5edb1bd448aa8072acfc47c23e9a, user_id=3b5127fab25e4848bfcd59cb26d36bad, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.215069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.233390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 962/1917] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:12 2021] PUT /identity/v3/projects/4e2b5edb1bd448aa8072acfc47c23e9a/users/3b5127fab25e4848bfcd59cb26d36bad/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:12.244576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496b1dc-48dd-4f62-8aaa-f19a762e9e8f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.321370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.322030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.322317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.322582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.323334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.327594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.327787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.329869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:12.339208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 956/1918] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:12.343950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.351415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43e46-fd1f-4be0-9f94-778eaad72ec0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.356858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.357759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.358051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.358314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] PATH_INFO: `/v3/projects/8ea9e693a4ab44fda25efd775330b000` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.358417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9791ec-6c3f-4d2d-ab01-9b23315d5974 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.359629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea9e693a4ab44fda25efd775330b000)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.361614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.365152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.366009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.366292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.366568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.367483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.369625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.384351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 957/1919] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:12.388113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.399830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bdc31-61f6-4e5b-82a1-f5b689a94842 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.416016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea9e693a4ab44fda25efd775330b000', 'request_id': 'req-45becc0a-3933-475f-802e-4dec3e230caa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:12.422930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea9e693a4ab44fda25efd775330b000', 'request_id': 'req-45becc0a-3933-475f-802e-4dec3e230caa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:12.430987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea9e693a4ab44fda25efd775330b000', 'request_id': 'req-45becc0a-3933-475f-802e-4dec3e230caa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:12.442260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] The token cache is being invalidate because project 8ea9e693a4ab44fda25efd775330b000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:12.442547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:12.443250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-45becc0a-3933-475f-802e-4dec3e230caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:12.445233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 963/1920] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:12 2021] DELETE /identity/v3/projects/8ea9e693a4ab44fda25efd775330b000 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:12.450949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6902ed-0e38-482e-a913-82a97b5739df None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.451339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6902ed-0e38-482e-a913-82a97b5739df None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.451695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6902ed-0e38-482e-a913-82a97b5739df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.467612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c71fde-6d6f-4845-ab77-ab453b68f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.469612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c71fde-6d6f-4845-ab77-ab453b68f014 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.469895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c71fde-6d6f-4845-ab77-ab453b68f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.470161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c71fde-6d6f-4845-ab77-ab453b68f014 admin admin] PATH_INFO: `/v3/projects/dd952bb1f88e4bd8b9301cc446f0ed36/users/554ad05460c34b8ca6ecced169da3bb1/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.474058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9d6902ed-0e38-482e-a913-82a97b5739df None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:12.475767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9d6902ed-0e38-482e-a913-82a97b5739df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:12.486725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 964/1921] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:12.487969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c71fde-6d6f-4845-ab77-ab453b68f014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd952bb1f88e4bd8b9301cc446f0ed36, user_id=554ad05460c34b8ca6ecced169da3bb1, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.490964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c71fde-6d6f-4845-ab77-ab453b68f014 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.496394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.496760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.497110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.508049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 958/1922] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:12 2021] PUT /identity/v3/projects/dd952bb1f88e4bd8b9301cc446f0ed36/users/554ad05460c34b8ca6ecced169da3bb1/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:12.518083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:12.518574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:12.520969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.521254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.521526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.550088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] MFA Rules not processed for user `554ad05460c34b8ca6ecced169da3bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:12.551414 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:12.582877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 965/1923] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:12.587229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.601263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91cf37-87dd-47f5-8ff3-013f1e43c2cd None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.613599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.614505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.614868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.615236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.616617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:12.618109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.620948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.644047 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 966/1924] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:15:12.645679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.671426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbf49a-58a8-4d8e-ace2-26a0e84c2d07 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.681790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.682565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.683011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.683390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.684292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.686593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.729613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 967/1925] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:12.730737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.833427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95a07-9b40-4070-b9fa-ee65d7c16d03 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.838465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.839244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.839682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.839930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.840737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.842761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.865946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 968/1926] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:12.869585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.870819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 959/1927] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:12.875392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.876862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:12.883299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e19d9-89c2-49e1-89ae-571b9fe5542f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.888745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.889487 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.889911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.890256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.891168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.892970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.894684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc49d3-6682-4204-b205-ddd0992ea6de None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.903542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.904364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.904722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.905079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.905849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 969/1928] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:12.905983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.909990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.912363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.922192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026abca2-ab88-434a-9a89-e0e8d077443a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:12.927715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:12.928463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:12.928820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:12.929267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:12.930089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:12.931892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:12.947098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 970/1929] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:12.950745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.950905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 960/1930] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:12.954504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:12.966632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befcfdd-2bbd-45ac-8bb3-bc6f80c5497d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.038241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08fff6-78d8-4563-8d4e-d9513176118b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.045520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76498-c144-457e-b558-016b783a9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.046203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76498-c144-457e-b558-016b783a9735 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.046491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76498-c144-457e-b558-016b783a9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.046772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76498-c144-457e-b558-016b783a9735 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.047580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e76498-c144-457e-b558-016b783a9735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.049525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e76498-c144-457e-b558-016b783a9735 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.060871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.061768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.062048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.062326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] PATH_INFO: `/v3/projects/722b58145d434e1181ebd90e63eb1255/users/e8f5b824c4204f5da272b60d907bb2a6/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.076594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 961/1931] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:12 2021] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:13.077236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a320-8c9b-4723-93a5-5472e6f2529c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.082010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722b58145d434e1181ebd90e63eb1255, user_id=e8f5b824c4204f5da272b60d907bb2a6, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.084934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.086038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a320-8c9b-4723-93a5-5472e6f2529c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.086343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a320-8c9b-4723-93a5-5472e6f2529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.100804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 971/1932] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:12 2021] PUT /identity/v3/projects/722b58145d434e1181ebd90e63eb1255/users/e8f5b824c4204f5da272b60d907bb2a6/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:13.101915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.122477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c1a3a320-8c9b-4723-93a5-5472e6f2529c None None] MFA Rules not processed for user `3b5127fab25e4848bfcd59cb26d36bad`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:13.123827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1a3a320-8c9b-4723-93a5-5472e6f2529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:13.184398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecf37-9760-4bcb-a150-9fb930e934f2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.188971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.189726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.190075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.190416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.191411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.193876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.198457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 962/1933] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:13 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:13.199899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.200243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.200860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.208289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 972/1934] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:13 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:13.209879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.212441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:13.233507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] MFA Rules not processed for user `e8f5b824c4204f5da272b60d907bb2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:13.234685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:13.272971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c353453-c39d-4125-bd27-1174c83ff83e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.276775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.277539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.277889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.278236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.280193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:13.308078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 963/1935] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:13 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:13.308893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.320901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e091-6bbd-4b93-9de7-0248b5d02e0c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.331719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.333807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.334237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.334775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] PATH_INFO: `/v3/projects/0acab00352f64e5f89f1892b79d094c8/users/02d82ace7fff468da6b3b4fa7bd3c165/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.355374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.356831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.360239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acab00352f64e5f89f1892b79d094c8, user_id=02d82ace7fff468da6b3b4fa7bd3c165, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.365003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.369449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 973/1936] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:13 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:13.370351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.372230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:13.386375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee42b-9d11-46fb-aea0-947f80533b53 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.386715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 964/1937] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:13 2021] PUT /identity/v3/projects/0acab00352f64e5f89f1892b79d094c8/users/02d82ace7fff468da6b3b4fa7bd3c165/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:13.390744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.459023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062867-cde3-40ec-9fba-84da33afc998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.459713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062867-cde3-40ec-9fba-84da33afc998 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.459991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062867-cde3-40ec-9fba-84da33afc998 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.460265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062867-cde3-40ec-9fba-84da33afc998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.479321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f93b-d0d1-4be2-9097-58de6eb82c02 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.486035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.487700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.489187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.489971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.491072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.493673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.507454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 965/1938] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:13 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:13.512091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.540512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062867-cde3-40ec-9fba-84da33afc998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.542051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062867-cde3-40ec-9fba-84da33afc998 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.548226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc968da-69af-46c8-9813-6c6f0e3bc7d7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.552379 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 974/1939] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:13.556600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.558350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.558891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.559332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] PATH_INFO: `/v3/projects/0acab00352f64e5f89f1892b79d094c8/users/02d82ace7fff468da6b3b4fa7bd3c165/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.562025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acab00352f64e5f89f1892b79d094c8, user_id=02d82ace7fff468da6b3b4fa7bd3c165, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.565059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.576698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 966/1940] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:13 2021] PUT /identity/v3/projects/0acab00352f64e5f89f1892b79d094c8/users/02d82ace7fff468da6b3b4fa7bd3c165/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:13.587796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.588248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.588543 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.619645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] MFA Rules not processed for user `02d82ace7fff468da6b3b4fa7bd3c165`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:13.620869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:13.718007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 975/1941] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:13 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:13.764623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:13.828100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c18e4-3a44-4bc0-bf82-226e1b9deeb2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:13.833584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6ae6-0cf6-4b46-8be2-42e636d91a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:13.834251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6ae6-0cf6-4b46-8be2-42e636d91a58 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:13.834533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6ae6-0cf6-4b46-8be2-42e636d91a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:13.834810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6ae6-0cf6-4b46-8be2-42e636d91a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:13.848735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b6ae6-0cf6-4b46-8be2-42e636d91a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:13.850702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b6ae6-0cf6-4b46-8be2-42e636d91a58 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:13.869004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 967/1942] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:13 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:15.195304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:15.253655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74e4e-85d3-49a6-b86f-0976f1a896e4 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:15.258623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:15.259505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:15.259783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:15.260051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] PATH_INFO: `/v3/users/554ad05460c34b8ca6ecced169da3bb1` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:15.261257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=554ad05460c34b8ca6ecced169da3bb1)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:15.263220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:15.308181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554ad05460c34b8ca6ecced169da3bb1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.308853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554ad05460c34b8ca6ecced169da3bb1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.320524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554ad05460c34b8ca6ecced169da3bb1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.321159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554ad05460c34b8ca6ecced169da3bb1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.328584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554ad05460c34b8ca6ecced169da3bb1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.341402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 976/1943] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:15 2021] DELETE /identity/v3/users/554ad05460c34b8ca6ecced169da3bb1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:15.345823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:15.346332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:15.346434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:15.364978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:15.366209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:15.424116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 968/1944] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:15.434330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:15.435730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:15.489712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5b4a-c30d-44c2-993b-d22a31f0f5ef admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:15.493509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:15.494160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:15.494444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:15.494715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:15.503591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:15.505695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:15.514643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 977/1945] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:15.760732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:15.762159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:15.776377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea0cdd-da87-4b73-95d0-2bbc85f909df None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:15.781343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:15.782188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:15.782466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:15.782737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] PATH_INFO: `/v3/projects/dd952bb1f88e4bd8b9301cc446f0ed36` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:15.784618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd952bb1f88e4bd8b9301cc446f0ed36)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:15.786916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:15.843985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd952bb1f88e4bd8b9301cc446f0ed36', 'request_id': 'req-d3bba731-671f-4cfe-b628-5ed437a54900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.855292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd952bb1f88e4bd8b9301cc446f0ed36', 'request_id': 'req-d3bba731-671f-4cfe-b628-5ed437a54900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.867873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd952bb1f88e4bd8b9301cc446f0ed36', 'request_id': 'req-d3bba731-671f-4cfe-b628-5ed437a54900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.879657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] The token cache is being invalidate because project dd952bb1f88e4bd8b9301cc446f0ed36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:15.879952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.880637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:15.882291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 969/1946] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:15 2021] DELETE /identity/v3/projects/dd952bb1f88e4bd8b9301cc446f0ed36 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:15.886150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:15.896274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737844d-265b-404e-9b4b-1c1f5554fd40 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:15.971933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:15.973415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:15.973865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:15.974145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] PATH_INFO: `/v3/users/02d82ace7fff468da6b3b4fa7bd3c165` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:15.975569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d82ace7fff468da6b3b4fa7bd3c165)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:15.977764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.029320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d82ace7fff468da6b3b4fa7bd3c165'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.029952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d82ace7fff468da6b3b4fa7bd3c165'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.042309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d82ace7fff468da6b3b4fa7bd3c165'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.043123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d82ace7fff468da6b3b4fa7bd3c165'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.050851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08ae2554-544b-416e-b5f1-0e8738d66b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d82ace7fff468da6b3b4fa7bd3c165'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.064504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 978/1947] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:15 2021] DELETE /identity/v3/users/02d82ace7fff468da6b3b4fa7bd3c165 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:16.328971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.330946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:16.354574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bba731-671f-4cfe-b628-5ed437a54900 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.424916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.425769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.426075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.426341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] PATH_INFO: `/v3/projects/0acab00352f64e5f89f1892b79d094c8` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.427559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acab00352f64e5f89f1892b79d094c8)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.429608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.488491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acab00352f64e5f89f1892b79d094c8', 'request_id': 'req-c5add422-bc60-43ac-b0dd-0574788fa12d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.495241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acab00352f64e5f89f1892b79d094c8', 'request_id': 'req-c5add422-bc60-43ac-b0dd-0574788fa12d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.503398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acab00352f64e5f89f1892b79d094c8', 'request_id': 'req-c5add422-bc60-43ac-b0dd-0574788fa12d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.515002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] The token cache is being invalidate because project 0acab00352f64e5f89f1892b79d094c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:16.515434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.516281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c5add422-bc60-43ac-b0dd-0574788fa12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:16.518138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 970/1948] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:16 2021] DELETE /identity/v3/projects/0acab00352f64e5f89f1892b79d094c8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:16.524691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.525762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.526151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.545462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:16.546782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:16.612350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 979/1949] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:16.621579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.621959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.622310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.642439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:16.643884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:16.652891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 971/1950] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:16.657256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.668121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf8f77-5ff7-4854-a224-9fc5647dcd4e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.673475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.674218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.674432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.674704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.675620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:16.675980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.677905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.690344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 980/1951] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:16.695083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.704036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58f62-0ecf-4b67-8f4f-b5aacfd95bc7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.709381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.710023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.710309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.710586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.711346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.713203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.739559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 972/1952] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:16 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:16.743832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.753789 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1494-e7d6-4215-b2e3-2d8f160e32a1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.810415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.811112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.811399 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.811677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.812383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.814286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.835567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 981/1953] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:16 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:16.845884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.857038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52b4ce-d0bf-472f-83f7-af846b8bf909 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.861776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.862514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.862866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.863441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.864176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.865752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.875960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 973/1954] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:16.879981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.890361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eb9e-4488-40e3-9138-47e4de889ec5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.895681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988a25-8100-4450-9fa5-2c6f0e127e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.896540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988a25-8100-4450-9fa5-2c6f0e127e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.896779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988a25-8100-4450-9fa5-2c6f0e127e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.897071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988a25-8100-4450-9fa5-2c6f0e127e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.897850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988a25-8100-4450-9fa5-2c6f0e127e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.899585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988a25-8100-4450-9fa5-2c6f0e127e73 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.912243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 982/1955] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:16.916459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:16.926280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf735c-cb9e-46a0-83f5-36e14a2c79f6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:16.931711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:16.932662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.933014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.933357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] PATH_INFO: `/v3/projects/480af37198ae4cb48aad662630bef045/users/887372a1dace4a2a99207a890ca5d3ad/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:16.948670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480af37198ae4cb48aad662630bef045, user_id=887372a1dace4a2a99207a890ca5d3ad, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:16.951364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:16.964468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 974/1956] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:16 2021] PUT /identity/v3/projects/480af37198ae4cb48aad662630bef045/users/887372a1dace4a2a99207a890ca5d3ad/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:16.975192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:16.975481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:16.975759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.023259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] MFA Rules not processed for user `887372a1dace4a2a99207a890ca5d3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:17.024667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:17.106343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 983/1957] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:17.107480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.202445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f990caf-a18d-465e-9daf-19b2e9b551e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.208763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.209627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.210044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.210449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.211703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.214048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.245469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 975/1958] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:17 2021] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:17.249659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.262247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483271-35ed-4fd0-ba58-be4a81a55836 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.337139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.338024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.338750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.338750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.339753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.341745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.378393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 984/1959] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:17 2021] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:17.383295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.393553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb193-7973-4854-a7b4-0a222df9fa6c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.398838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.399529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.399814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.400091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.400829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.402406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.413058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 976/1960] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:17.417692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.427558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb366fa8-4d24-44ac-9073-9db757007ca3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.432515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.433437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.433831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.434115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] PATH_INFO: `/v3/projects/fd78635306f94cf8baf0b150f0d5c129/users/d97ff22262ef41c3a416093ff3a35ab1/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.449021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd78635306f94cf8baf0b150f0d5c129, user_id=d97ff22262ef41c3a416093ff3a35ab1, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.452106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.464927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 985/1961] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:17 2021] PUT /identity/v3/projects/fd78635306f94cf8baf0b150f0d5c129/users/d97ff22262ef41c3a416093ff3a35ab1/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:17.468878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.478564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784fe3e-9f1e-42d8-9443-8477ef7d0f7f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.532654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36645c7a-c70f-49ad-986b-8d883c6ca378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.533311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36645c7a-c70f-49ad-986b-8d883c6ca378 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.533588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36645c7a-c70f-49ad-986b-8d883c6ca378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.533863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36645c7a-c70f-49ad-986b-8d883c6ca378 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.534581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36645c7a-c70f-49ad-986b-8d883c6ca378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.536212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36645c7a-c70f-49ad-986b-8d883c6ca378 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.546010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 977/1962] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:17 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:17.549898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.560243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554bcd-4992-47fa-8f6b-878b0c05aafc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.564916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.565787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.566063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.566334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] PATH_INFO: `/v3/projects/fd78635306f94cf8baf0b150f0d5c129/users/d97ff22262ef41c3a416093ff3a35ab1/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.568854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd78635306f94cf8baf0b150f0d5c129, user_id=d97ff22262ef41c3a416093ff3a35ab1, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.571521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.582003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 986/1963] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:17 2021] PUT /identity/v3/projects/fd78635306f94cf8baf0b150f0d5c129/users/d97ff22262ef41c3a416093ff3a35ab1/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:17.592322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.592614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.592892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.618787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] MFA Rules not processed for user `d97ff22262ef41c3a416093ff3a35ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:17.619976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:17.683663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 978/1964] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:17 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:17.695497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:17.697171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:17.752102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f23e-3cc8-488b-8f64-6132660aa6ed admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:17.755696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d5085-3f63-4ff8-a403-8e440f6e0961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:17.756312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5085-3f63-4ff8-a403-8e440f6e0961 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:17.756588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5085-3f63-4ff8-a403-8e440f6e0961 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:17.756856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5085-3f63-4ff8-a403-8e440f6e0961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:17.765470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d5085-3f63-4ff8-a403-8e440f6e0961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:17.766883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d5085-3f63-4ff8-a403-8e440f6e0961 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:17.776962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 987/1965] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:17 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:17.997258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:18.007535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e319-90f9-4865-9bac-d43c4507ef80 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:18.011257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:18.011905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:18.012186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:18.013049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:18.014733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:18.091135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:18.094976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:18.107291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 979/1966] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:17 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:18.122435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:18.124165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:18.125044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:18.145842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:18.161091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a85934-b0cf-4885-b8d1-f90776beb67a service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:18.161854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] MFA Rules not processed for user `e8f5b824c4204f5da272b60d907bb2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:18.163317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:18.171759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd97ff22262ef41c3a416093ff3a35ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd78635306f94cf8baf0b150f0d5c129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:18.172511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:18.174945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:18.175458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:18.177014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:18.178569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:18.182808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:18.222242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 980/1967] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:18.223709 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:18.234724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 988/1968] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:18 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:18.243977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2396d-5320-4195-8a8b-c1fdbd8b3d92 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:18.276048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd97ff22262ef41c3a416093ff3a35ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd78635306f94cf8baf0b150f0d5c129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:18.277119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:18.278452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:18.278452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:18.279003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:18.292751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:18.381277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 981/1969] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:18 2021] POST /identity/v3/projects => generated 354 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:18.386421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:18.412287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa951f1-bccd-477c-803b-cce62e520ca7 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:18.527941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd97ff22262ef41c3a416093ff3a35ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd78635306f94cf8baf0b150f0d5c129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:18.528772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:18.529146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:18.529663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:18.530383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:18.530797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:18.532574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:18.546794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 989/1970] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:18.591291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:18.603610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee617ff-d808-457f-ac7b-2150f61d4243 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:18.609125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd97ff22262ef41c3a416093ff3a35ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd78635306f94cf8baf0b150f0d5c129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:18.611117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:18.611595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:18.611876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] PATH_INFO: `/v3/projects/0820c6b7f291490b8fa451b4842cdb98` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:18.613446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0820c6b7f291490b8fa451b4842cdb98)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:18.615427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:18.680699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0820c6b7f291490b8fa451b4842cdb98', 'request_id': 'req-0dc16d70-54ee-42be-9665-c76ae2576f29'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:18.689554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0820c6b7f291490b8fa451b4842cdb98', 'request_id': 'req-0dc16d70-54ee-42be-9665-c76ae2576f29'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:18.700238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0820c6b7f291490b8fa451b4842cdb98', 'request_id': 'req-0dc16d70-54ee-42be-9665-c76ae2576f29'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:18.717429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] The token cache is being invalidate because project 0820c6b7f291490b8fa451b4842cdb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:18.717928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:18.718823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0dc16d70-54ee-42be-9665-c76ae2576f29 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:18.724653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 982/1971] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:18 2021] DELETE /identity/v3/projects/0820c6b7f291490b8fa451b4842cdb98 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:19.028055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:19.030180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:19.168685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdc68a-0e66-4746-a242-13d1a0b78e75 tempest-VolumeQuotaClassesTest-1712684145 tempest-VolumeQuotaClassesTest-1712684145-project-admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:19.257478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:19.258624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:19.259032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:19.259346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] PATH_INFO: `/v3/users/887372a1dace4a2a99207a890ca5d3ad` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:19.260929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] RBAC: Authorizing `identity:delete_user(user_id=887372a1dace4a2a99207a890ca5d3ad)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:19.263182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:19.339007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887372a1dace4a2a99207a890ca5d3ad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.340042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887372a1dace4a2a99207a890ca5d3ad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.355874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887372a1dace4a2a99207a890ca5d3ad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.356834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887372a1dace4a2a99207a890ca5d3ad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.366425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887372a1dace4a2a99207a890ca5d3ad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.383494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 990/1972] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:19 2021] DELETE /identity/v3/users/887372a1dace4a2a99207a890ca5d3ad => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:19.388252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:19.388659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:19.389146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:19.409522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:19.410995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:19.479186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 983/1973] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:19.491092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:19.492610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:19.560488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010e17-81a1-4ddf-9757-40fe4ce563df admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:19.570325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ff9d0-181b-42da-8ecc-9b83a7c2c465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:19.571172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff9d0-181b-42da-8ecc-9b83a7c2c465 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:19.571442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff9d0-181b-42da-8ecc-9b83a7c2c465 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:19.571779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff9d0-181b-42da-8ecc-9b83a7c2c465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:19.583380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff9d0-181b-42da-8ecc-9b83a7c2c465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:19.585131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff9d0-181b-42da-8ecc-9b83a7c2c465 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:19.595636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 991/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:19.743068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:19.743068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:19.755731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab4cd2-7b6a-46d5-93bd-c9ffa916df6e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:19.765551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:19.766640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:19.769156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:19.770275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] PATH_INFO: `/v3/users/7bf53443ecfa43e3b1d5910a3be15276` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:19.772305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf53443ecfa43e3b1d5910a3be15276)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:19.779643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:19.850726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf53443ecfa43e3b1d5910a3be15276'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.859889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf53443ecfa43e3b1d5910a3be15276'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.860614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf53443ecfa43e3b1d5910a3be15276'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.873912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf53443ecfa43e3b1d5910a3be15276'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.888764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf53443ecfa43e3b1d5910a3be15276'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:19.897857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 984/1975] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:19 2021] DELETE /identity/v3/users/7bf53443ecfa43e3b1d5910a3be15276 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:19.902610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:19.902920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:19.903384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:19.932904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:19.935308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:19.967774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:19.970200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:20.071061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 992/1976] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:20.079540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:20.083375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:20.113797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd971-b557-4152-9552-fefa8f3f1fdd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:20.119017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:20.120120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:20.120346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:20.120629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] PATH_INFO: `/v3/projects/480af37198ae4cb48aad662630bef045` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:20.121930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480af37198ae4cb48aad662630bef045)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:20.124112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:20.184487 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f6378-6580-455e-94bc-82e65fc48e66 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:20.190244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480af37198ae4cb48aad662630bef045', 'request_id': 'req-dce0c10c-4265-43ac-89ef-9b45ead87664'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.196915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480af37198ae4cb48aad662630bef045', 'request_id': 'req-dce0c10c-4265-43ac-89ef-9b45ead87664'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.205979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480af37198ae4cb48aad662630bef045', 'request_id': 'req-dce0c10c-4265-43ac-89ef-9b45ead87664'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.217489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] The token cache is being invalidate because project 480af37198ae4cb48aad662630bef045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:20.217898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.218589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.220438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 985/1977] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:19 2021] DELETE /identity/v3/projects/480af37198ae4cb48aad662630bef045 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:20.224489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:20.225845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:20.246195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:20.246996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:20.247326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:20.248497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:20.258413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:20.296345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c10c-4265-43ac-89ef-9b45ead87664 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:20.301355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:20.302203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:20.302481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:20.302775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] PATH_INFO: `/v3/users/d97ff22262ef41c3a416093ff3a35ab1` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:20.304005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97ff22262ef41c3a416093ff3a35ab1)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:20.305889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:20.320439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:20.321870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:20.334078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 993/1978] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:20.354245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97ff22262ef41c3a416093ff3a35ab1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.361544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97ff22262ef41c3a416093ff3a35ab1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.363577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97ff22262ef41c3a416093ff3a35ab1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.378171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97ff22262ef41c3a416093ff3a35ab1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.387670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-582cdfe9-5b15-4435-b724-f3d0376400c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97ff22262ef41c3a416093ff3a35ab1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:20.394538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 986/1979] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:20 2021] DELETE /identity/v3/users/d97ff22262ef41c3a416093ff3a35ab1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:20.895433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:20.911983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb8d3-7c8f-436d-9104-d8cb817b450e service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:21.028842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:21.029784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.030069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.030651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] PATH_INFO: `/v3/projects/fd78635306f94cf8baf0b150f0d5c129` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.032180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd78635306f94cf8baf0b150f0d5c129)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:21.034156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:21.102495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd78635306f94cf8baf0b150f0d5c129', 'request_id': 'req-531f3d40-d3bd-4b2b-b77a-414490058e3e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.115283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd78635306f94cf8baf0b150f0d5c129', 'request_id': 'req-531f3d40-d3bd-4b2b-b77a-414490058e3e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.128220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd78635306f94cf8baf0b150f0d5c129', 'request_id': 'req-531f3d40-d3bd-4b2b-b77a-414490058e3e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.165693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] The token cache is being invalidate because project fd78635306f94cf8baf0b150f0d5c129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:21.167356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.168454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.179504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 994/1980] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:20 2021] DELETE /identity/v3/projects/fd78635306f94cf8baf0b150f0d5c129 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:21.186127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d385a0-1055-4ee8-a4c3-a9cd9c0d2d50 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.186737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d385a0-1055-4ee8-a4c3-a9cd9c0d2d50 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.186737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d385a0-1055-4ee8-a4c3-a9cd9c0d2d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.227652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:21.229089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:21.261578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-93d385a0-1055-4ee8-a4c3-a9cd9c0d2d50 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:21.262825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-93d385a0-1055-4ee8-a4c3-a9cd9c0d2d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:21.383758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3d40-d3bd-4b2b-b77a-414490058e3e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:21.394262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:21.396054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.396186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.396430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] PATH_INFO: `/v3/projects/8bfddaaf2c8d4e40a54376f425c6f222` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.403030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfddaaf2c8d4e40a54376f425c6f222)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:21.406439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:21.422482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 987/1981] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:21.429816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.430852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.430852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.475072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:21.476303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:21.504535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfddaaf2c8d4e40a54376f425c6f222', 'request_id': 'req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.512197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfddaaf2c8d4e40a54376f425c6f222', 'request_id': 'req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.522572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfddaaf2c8d4e40a54376f425c6f222', 'request_id': 'req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.540740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] The token cache is being invalidate because project 8bfddaaf2c8d4e40a54376f425c6f222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:21.541038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.542109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.547140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 995/1982] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:21 2021] DELETE /identity/v3/projects/8bfddaaf2c8d4e40a54376f425c6f222 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:21.548280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:21.551633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:21.574265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 988/1983] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:21.578948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:21.600507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fafa2-a837-4e92-9c3b-f42cf306c879 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:21.622155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:21.623073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.623522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.623819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.624694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:21.625016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:21.634157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:21.648553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3303b-72b5-4d8c-8ea7-69f72ca53227 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:21.659477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 989/1984] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:21.664850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:21.666315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:21.667529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.668140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.668639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] PATH_INFO: `/v3/users/9e11120c64774b018dff3d1f7d45790e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.675489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ec2fc-7bf7-4579-84fa-93913b5c563d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:21.677143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e11120c64774b018dff3d1f7d45790e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:21.680875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:21.681516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.681794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.682067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.682767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:21.683280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:21.684661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:21.724735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 990/1985] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:21 2021] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:21.728757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:21.807359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e11120c64774b018dff3d1f7d45790e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.808332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e11120c64774b018dff3d1f7d45790e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.831083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014659b4-3cae-4ec1-a61e-f903e72619c3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:21.843996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e11120c64774b018dff3d1f7d45790e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.846503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e11120c64774b018dff3d1f7d45790e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.854105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:21.855252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:21.855618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:21.855902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:21.856711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:21.860782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e11120c64774b018dff3d1f7d45790e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:21.864622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:21.889416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 996/1986] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:21 2021] DELETE /identity/v3/users/9e11120c64774b018dff3d1f7d45790e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:21.901950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 991/1987] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:21 2021] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:21.903232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:21.905038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:21.999684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546159f-89bb-496a-b7ba-045cfdfd9561 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.008349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.009650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.010175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.010668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.011701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.013623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.028061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 997/1988] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:21 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:22.032013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.053776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659faeea-916b-4137-8172-5a15bdcee545 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.067979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c8b37-667f-43f6-9ae5-33e8b02bc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.068791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c8b37-667f-43f6-9ae5-33e8b02bc012 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.069172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c8b37-667f-43f6-9ae5-33e8b02bc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.069583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c8b37-667f-43f6-9ae5-33e8b02bc012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.070765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c8b37-667f-43f6-9ae5-33e8b02bc012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.075343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c8b37-667f-43f6-9ae5-33e8b02bc012 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.089218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 992/1989] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:22 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:22.094116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.112956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea6bdc-7c07-4c26-9ccf-c7ed6aa7e0d0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.122301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.123483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.125111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.125674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] PATH_INFO: `/v3/projects/e7e211fbf56f41c8aff15cac9686aaf9/users/bfb938870c5b47e1bf5e6bc3668f1890/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.149452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e211fbf56f41c8aff15cac9686aaf9, user_id=bfb938870c5b47e1bf5e6bc3668f1890, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.152763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.172625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 998/1990] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:22 2021] PUT /identity/v3/projects/e7e211fbf56f41c8aff15cac9686aaf9/users/bfb938870c5b47e1bf5e6bc3668f1890/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:22.183786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.183898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.184393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.305350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] MFA Rules not processed for user `bfb938870c5b47e1bf5e6bc3668f1890`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:22.306586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:22.422458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 993/1991] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:22 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:22.427909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.521616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981216c-5e43-4e7a-85db-1d61900fd903 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.527950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.529150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.529935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.530472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.531484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.533507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.612227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 999/1992] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:22 2021] POST /identity/v3/projects => generated 391 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:22.617180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.635470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.636661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508ad64-0ae1-4772-9eaa-cbfd38af0cad None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.638864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:22.806734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09564c-04bc-41a9-b46d-0c3405b91ad9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.817109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.818352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.819895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.820209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.820513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.820858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.821188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.821994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] PATH_INFO: `/v3/projects/e51acd9b757d4579ad184fd39ab89232` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.823057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.824377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51acd9b757d4579ad184fd39ab89232)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.826367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.827884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.863877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 994/1993] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:22 2021] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:22.869573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.891023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff2fff-a44d-40ae-9136-ed125136bbe7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.897849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:22.898758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:22.899055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:22.899339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:22.900075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:22.901958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:22.929748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 995/1994] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:22 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:22.931054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:22.942929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa7ea0-e61b-4265-a374-f16043cb49eb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:22.955002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51acd9b757d4579ad184fd39ab89232', 'request_id': 'req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:22.970462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51acd9b757d4579ad184fd39ab89232', 'request_id': 'req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:22.990295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51acd9b757d4579ad184fd39ab89232', 'request_id': 'req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:23.010461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] The token cache is being invalidate because project e51acd9b757d4579ad184fd39ab89232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:23.010902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:23.012271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-fd778e4f-f6ef-4944-aa18-e435b4bdb68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:23.015476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1000/1995] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:22 2021] DELETE /identity/v3/projects/e51acd9b757d4579ad184fd39ab89232 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:23.022555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b107d-1419-411f-9f33-203cf020f367 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.022555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b107d-1419-411f-9f33-203cf020f367 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.023451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b107d-1419-411f-9f33-203cf020f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.053787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ce8b107d-1419-411f-9f33-203cf020f367 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:23.071383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ce8b107d-1419-411f-9f33-203cf020f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.093549 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.095091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.095381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.095649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] PATH_INFO: `/v3/projects/159535c867da4520a3145f898c1ebb5c/users/dc00cec73b9d41ef9df72fdbb236d63d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.132849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=159535c867da4520a3145f898c1ebb5c, user_id=dc00cec73b9d41ef9df72fdbb236d63d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.135661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.161026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 996/1996] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:22 2021] PUT /identity/v3/projects/159535c867da4520a3145f898c1ebb5c/users/dc00cec73b9d41ef9df72fdbb236d63d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:23.162850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.167232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.181774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1001/1997] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:23.194777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.196151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.196380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.218123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:23.219580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.332816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e9939-e6ce-44bd-b3a7-2b06977f47cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.340936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.342256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.342683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.343133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.344309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.348714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.352744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1002/1998] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:23.357994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.378317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ab2f6-3641-4001-b10d-d399c461725d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.378443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 997/1999] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:23 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:23.383697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.386124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.387107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.387455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.387797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.388753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:23.389130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.391291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.402164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f1780-6437-4a4f-89c9-0bce569bd6c2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.407336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10f7b-2128-4575-9744-de5a5ca30e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.408293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10f7b-2128-4575-9744-de5a5ca30e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.408554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10f7b-2128-4575-9744-de5a5ca30e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.408827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10f7b-2128-4575-9744-de5a5ca30e91 admin admin] PATH_INFO: `/v3/projects/159535c867da4520a3145f898c1ebb5c/users/dc00cec73b9d41ef9df72fdbb236d63d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.411169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1003/2000] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:15:23.411904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef10f7b-2128-4575-9744-de5a5ca30e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159535c867da4520a3145f898c1ebb5c, user_id=dc00cec73b9d41ef9df72fdbb236d63d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.415347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef10f7b-2128-4575-9744-de5a5ca30e91 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.415749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.426688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f33d-ba5d-4d67-a7f5-b4ad264c50f8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.439679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 998/2001] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:23 2021] PUT /identity/v3/projects/159535c867da4520a3145f898c1ebb5c/users/dc00cec73b9d41ef9df72fdbb236d63d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:23.451177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.451472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.451745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.481483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] MFA Rules not processed for user `dc00cec73b9d41ef9df72fdbb236d63d`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:23.482723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.502623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.503912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.504620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.504970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.505805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.508411 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.547211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1004/2002] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:23.551715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.577836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 999/2003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:23.588302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.589782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.633581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042c57-23c2-4619-b1ec-a36ecb796ddc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.641927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.643602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.645043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.645420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.646243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.650358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.664654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4081de2-807c-40a6-b57a-0f6fbc4e6a63 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.678381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1005/2004] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:23.679400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.691157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc6d93-4cab-440b-a59f-2a4813951025 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.697456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.698667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.699076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.699686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.700802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.703308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.718489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1006/2005] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:23 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:23.720426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ec01-d5f0-4e57-8728-a89ae9ace6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.721258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ec01-d5f0-4e57-8728-a89ae9ace6ec service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.721717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ec01-d5f0-4e57-8728-a89ae9ace6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.721999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ec01-d5f0-4e57-8728-a89ae9ace6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.723641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.733659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cc06-935b-4c72-aacf-072ffcd1e728 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.740681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.741588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.742032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.742464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.743866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.746384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.763982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1007/2006] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:23 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:23.771791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.786340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7523a7c-858f-4564-985f-bf835d055ed0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:23.796747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:23.806161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.806161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.806161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] PATH_INFO: `/v3/projects/60afd7ca66854360bb595d54815822f5/users/07d38586f15f4c10bec07e14ccfb1acb/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.807207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ec01-d5f0-4e57-8728-a89ae9ace6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.809480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ec01-d5f0-4e57-8728-a89ae9ace6ec service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.819795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1000/2007] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:23 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:23.824008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60afd7ca66854360bb595d54815822f5, user_id=07d38586f15f4c10bec07e14ccfb1acb, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:23.829093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:23.847553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1008/2008] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:23 2021] PUT /identity/v3/projects/60afd7ca66854360bb595d54815822f5/users/07d38586f15f4c10bec07e14ccfb1acb/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:23.858686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:23.859679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:23.860028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:23.890071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:23.892041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.903215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] MFA Rules not processed for user `07d38586f15f4c10bec07e14ccfb1acb`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:23.904735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:23.995341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1001/2009] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:23.999475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.005452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90853edb-e0b5-4bba-ae85-ad0488448b67 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.009131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.009795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.010077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.010342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.012231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:24.081328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.081446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9727-b1df-46fd-87fd-f2e2ff9d9cb8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.083908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.087697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.088443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.088793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.089280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.091201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.093619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.095295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1009/2010] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:23 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:24.141352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1002/2011] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:23 2021] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:24.143589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.158569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636041f-adff-45b6-a9bd-50d9bf43a72e service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.264428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.265583 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.265998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.266401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.267513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.270683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.297741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1010/2012] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:24 2021] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:24.303334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.326965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567878-dc95-459c-a1d4-329c2dca4c3d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.338912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.344636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.345079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.345543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.346470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.349858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.377232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1003/2013] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:24.383225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.396181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50520eaf-9b47-4866-b5f3-ddd69cbe1e69 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.402587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.403659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.403811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.404302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] PATH_INFO: `/v3/projects/8928f0eef8d64150a128cc11a7a7e306/users/ccfdbee164084fea9f4697e272cc895c/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.436923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8928f0eef8d64150a128cc11a7a7e306, user_id=ccfdbee164084fea9f4697e272cc895c, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.439720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.460364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1011/2014] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:24 2021] PUT /identity/v3/projects/8928f0eef8d64150a128cc11a7a7e306/users/ccfdbee164084fea9f4697e272cc895c/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:24.464288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.476472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a9fd-782d-44a1-9c81-9418bc003ae5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.637691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027079e8-1ddc-4467-b6fc-12dc00f4a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.640517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027079e8-1ddc-4467-b6fc-12dc00f4a09f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.640910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027079e8-1ddc-4467-b6fc-12dc00f4a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.641938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027079e8-1ddc-4467-b6fc-12dc00f4a09f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.643594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027079e8-1ddc-4467-b6fc-12dc00f4a09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.648517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027079e8-1ddc-4467-b6fc-12dc00f4a09f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.670326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.677236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1004/2015] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:24.685880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f88814-2e94-4e8b-876a-a0a9516f4dca admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.703005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.703955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.704237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.704503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] PATH_INFO: `/v3/projects/8928f0eef8d64150a128cc11a7a7e306/users/ccfdbee164084fea9f4697e272cc895c/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.706735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8928f0eef8d64150a128cc11a7a7e306, user_id=ccfdbee164084fea9f4697e272cc895c, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.710193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.721813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1012/2016] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:24 2021] PUT /identity/v3/projects/8928f0eef8d64150a128cc11a7a7e306/users/ccfdbee164084fea9f4697e272cc895c/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:24.734179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.734746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.735089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.770851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] MFA Rules not processed for user `ccfdbee164084fea9f4697e272cc895c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:24.772200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:24.843648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1005/2017] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:24 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:24.854286 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:24.911853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81aab-8a5b-41d8-b1b6-0a8875b14ec0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:24.915429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:24.916060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:24.916343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:24.916616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:24.925897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:24.927362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:24.936679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1013/2018] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:24 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:25.028244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:25.038299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a165e-95af-4eee-b0ff-25e6e2c4cbf5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:25.042121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103897-9355-463f-8905-e85d77f029d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:25.042780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103897-9355-463f-8905-e85d77f029d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:25.043185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103897-9355-463f-8905-e85d77f029d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:25.043347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103897-9355-463f-8905-e85d77f029d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:25.116504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103897-9355-463f-8905-e85d77f029d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:25.117903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103897-9355-463f-8905-e85d77f029d8 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:25.129514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1006/2019] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:25 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:25.381745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:25.442106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea93b5-b94b-4f69-bc5e-c3c4c379c568 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:25.446869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:25.447767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:25.448050 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:25.448324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] PATH_INFO: `/v3/users/07d38586f15f4c10bec07e14ccfb1acb` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:25.449517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d38586f15f4c10bec07e14ccfb1acb)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:25.451459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:25.497694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d38586f15f4c10bec07e14ccfb1acb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:25.498481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d38586f15f4c10bec07e14ccfb1acb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:25.511774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d38586f15f4c10bec07e14ccfb1acb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:25.512475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d38586f15f4c10bec07e14ccfb1acb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:25.521259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d38586f15f4c10bec07e14ccfb1acb'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:25.544015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1014/2020] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:25 2021] DELETE /identity/v3/users/07d38586f15f4c10bec07e14ccfb1acb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:25.544116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:25.544116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:25.544116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:25.561127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:25.562413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:25.619144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1007/2021] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:25.629599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:25.630986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:25.689890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d03ed-bc17-45be-ba4e-bd45d829096c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:25.693665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:25.694302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:25.694587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:25.694863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:25.704560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:25.706058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:25.715727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1015/2022] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:26.150941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:26.152595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:26.164797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55abb13-3dfb-4251-9aca-baee900a21fa None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:26.169353 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:26.170186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:26.170461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:26.170725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] PATH_INFO: `/v3/projects/60afd7ca66854360bb595d54815822f5` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:26.171997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60afd7ca66854360bb595d54815822f5)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:26.173886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:26.231416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60afd7ca66854360bb595d54815822f5', 'request_id': 'req-c3522ef4-a236-46a7-808c-1d80b9752c16'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.238362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60afd7ca66854360bb595d54815822f5', 'request_id': 'req-c3522ef4-a236-46a7-808c-1d80b9752c16'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.246679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60afd7ca66854360bb595d54815822f5', 'request_id': 'req-c3522ef4-a236-46a7-808c-1d80b9752c16'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.260363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] The token cache is being invalidate because project 60afd7ca66854360bb595d54815822f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:26.260656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.261446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.263359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1008/2023] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:26 2021] DELETE /identity/v3/projects/60afd7ca66854360bb595d54815822f5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:26.267096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:26.277852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4df401-e1fc-4ad6-a125-fa4d4e93fa7c service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:26.340566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:26.341440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:26.341724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:26.341997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] PATH_INFO: `/v3/users/ccfdbee164084fea9f4697e272cc895c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:26.343474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccfdbee164084fea9f4697e272cc895c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:26.345638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:26.398480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccfdbee164084fea9f4697e272cc895c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.399114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccfdbee164084fea9f4697e272cc895c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.410635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccfdbee164084fea9f4697e272cc895c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.411312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccfdbee164084fea9f4697e272cc895c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.419079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5df25ed7-269c-4487-9bce-6d4ff6ac37b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccfdbee164084fea9f4697e272cc895c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.431391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1016/2024] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:26 2021] DELETE /identity/v3/users/ccfdbee164084fea9f4697e272cc895c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:26.787602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:26.789808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:26.821510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522ef4-a236-46a7-808c-1d80b9752c16 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:26.886486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:26.887572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:26.888021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:26.888444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] PATH_INFO: `/v3/projects/8928f0eef8d64150a128cc11a7a7e306` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:26.890499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8928f0eef8d64150a128cc11a7a7e306)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:26.892632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:26.947287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8928f0eef8d64150a128cc11a7a7e306', 'request_id': 'req-78b8fe94-0815-4ff6-b840-27e32d26a3d1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.953954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8928f0eef8d64150a128cc11a7a7e306', 'request_id': 'req-78b8fe94-0815-4ff6-b840-27e32d26a3d1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.962852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8928f0eef8d64150a128cc11a7a7e306', 'request_id': 'req-78b8fe94-0815-4ff6-b840-27e32d26a3d1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.975516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] The token cache is being invalidate because project 8928f0eef8d64150a128cc11a7a7e306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:26.975516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.975516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78b8fe94-0815-4ff6-b840-27e32d26a3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:26.977332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1009/2025] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:26 2021] DELETE /identity/v3/projects/8928f0eef8d64150a128cc11a7a7e306 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:26.982778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:26.983098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:26.983391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.003560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:27.005381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:27.073236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1017/2026] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:27.081597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.082575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.082716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.111979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:27.113625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:27.123295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1010/2027] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:27.127609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.139078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143fa5-88eb-44a5-92b0-724d5849ed59 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.144080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.145462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.145887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.146302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.147391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:27.147840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.149555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.162864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1018/2028] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:27.167019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.178159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2177a77-a010-4596-900e-bcdf2dcb815d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.184446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.185513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.185513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.185862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.186706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.188824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.228054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.228626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1011/2029] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:27 2021] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:27.253340 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2672d-651f-44b1-8744-810790a67c98 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.345165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.346198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.346564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.346999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.348137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.350201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.384907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1019/2030] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:27 2021] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:27.386079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.404013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfb353-af53-4156-bb2c-43a1ea641616 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.418976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.419827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.420120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.420402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.421766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.427684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.444383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1012/2031] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:27.448539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.462712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55914f0-14cc-4c08-aa85-a38eaf397455 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.468585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1d779-87d6-4e18-aafc-44c2b7a55748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.469270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1d779-87d6-4e18-aafc-44c2b7a55748 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.470308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1d779-87d6-4e18-aafc-44c2b7a55748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.470588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1d779-87d6-4e18-aafc-44c2b7a55748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.471368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1d779-87d6-4e18-aafc-44c2b7a55748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.473425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1d779-87d6-4e18-aafc-44c2b7a55748 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.487143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1020/2032] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:27.491700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.506546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cdd5f-3926-4940-aa3b-b17c8feff30c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.513607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.514538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.514819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.515115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] PATH_INFO: `/v3/projects/663addf663794cdb9f10a8bfe14d990d/users/b6a28d5a77f645dc94149e9a64bdbed4/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.533182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=663addf663794cdb9f10a8bfe14d990d, user_id=b6a28d5a77f645dc94149e9a64bdbed4, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.536516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.567976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1013/2033] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:27 2021] PUT /identity/v3/projects/663addf663794cdb9f10a8bfe14d990d/users/b6a28d5a77f645dc94149e9a64bdbed4/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:27.569856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.570009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.570261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.607494 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] MFA Rules not processed for user `b6a28d5a77f645dc94149e9a64bdbed4`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:27.608980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:27.717564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1021/2034] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:27.731197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:27.732983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:27.804827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb66b4-290a-4ac1-8097-77456b3d4cec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:27.810269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146a927-6229-4a5e-9466-754eff609431 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:27.810982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a927-6229-4a5e-9466-754eff609431 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:27.811888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a927-6229-4a5e-9466-754eff609431 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:27.812287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a927-6229-4a5e-9466-754eff609431 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:27.831238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146a927-6229-4a5e-9466-754eff609431 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:27.834875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146a927-6229-4a5e-9466-754eff609431 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:27.849517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1014/2035] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:27 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:29.051547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:29.053040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:29.133497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5b21-3f1c-456f-b785-0944f14c6355 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:29.139709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:29.140607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:29.140892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:29.141169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] PATH_INFO: `/v3/users/bfb938870c5b47e1bf5e6bc3668f1890` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:29.142621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb938870c5b47e1bf5e6bc3668f1890)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:29.148200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:29.214216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb938870c5b47e1bf5e6bc3668f1890'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.214888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb938870c5b47e1bf5e6bc3668f1890'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.237182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb938870c5b47e1bf5e6bc3668f1890'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.238861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb938870c5b47e1bf5e6bc3668f1890'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.251210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb938870c5b47e1bf5e6bc3668f1890'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.270294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1022/2036] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:29 2021] DELETE /identity/v3/users/bfb938870c5b47e1bf5e6bc3668f1890 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:29.274956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:29.275512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:29.275784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:29.292839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:29.294045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:29.352324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1015/2037] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:29.363438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:29.365070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:29.437386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6f41-ab82-4461-a147-e5ef8a85266d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:29.442009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:29.442652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:29.442938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:29.443368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:29.453464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:29.455086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:29.465523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1023/2038] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:29.742877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:29.744306 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:29.758088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109fd8-4ba0-4ecd-9788-761f505e7c81 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:29.763021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:29.763892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:29.764343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:29.765006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] PATH_INFO: `/v3/projects/e7e211fbf56f41c8aff15cac9686aaf9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:29.766025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e211fbf56f41c8aff15cac9686aaf9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:29.767996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:29.822661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e211fbf56f41c8aff15cac9686aaf9', 'request_id': 'req-a23547f6-d296-428a-855b-f879024b7885'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.829234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e211fbf56f41c8aff15cac9686aaf9', 'request_id': 'req-a23547f6-d296-428a-855b-f879024b7885'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.838978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e211fbf56f41c8aff15cac9686aaf9', 'request_id': 'req-a23547f6-d296-428a-855b-f879024b7885'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.852233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] The token cache is being invalidate because project e7e211fbf56f41c8aff15cac9686aaf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:29.852719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.853365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.854982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1016/2039] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:29 2021] DELETE /identity/v3/projects/e7e211fbf56f41c8aff15cac9686aaf9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:29.859030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:29.870295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d01704-5141-4c2f-bfe4-d90b283ef08b service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:29.940592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:29.941522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:29.941800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:29.942070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] PATH_INFO: `/v3/users/dc00cec73b9d41ef9df72fdbb236d63d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:29.943307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc00cec73b9d41ef9df72fdbb236d63d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:29.945217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:29.989935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc00cec73b9d41ef9df72fdbb236d63d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:29.990579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc00cec73b9d41ef9df72fdbb236d63d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.001817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc00cec73b9d41ef9df72fdbb236d63d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.002440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc00cec73b9d41ef9df72fdbb236d63d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.009766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0f48ee36-5fe6-4c10-abc2-1f3c28dd9d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc00cec73b9d41ef9df72fdbb236d63d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.022116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1024/2040] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:29 2021] DELETE /identity/v3/users/dc00cec73b9d41ef9df72fdbb236d63d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:30.343259 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.344934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:30.358671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23547f6-d296-428a-855b-f879024b7885 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.431509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.432391 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.432707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.432979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] PATH_INFO: `/v3/projects/159535c867da4520a3145f898c1ebb5c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.434175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=159535c867da4520a3145f898c1ebb5c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.436081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.480212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159535c867da4520a3145f898c1ebb5c', 'request_id': 'req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.486058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159535c867da4520a3145f898c1ebb5c', 'request_id': 'req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.497526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159535c867da4520a3145f898c1ebb5c', 'request_id': 'req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.509186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] The token cache is being invalidate because project 159535c867da4520a3145f898c1ebb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:30.509469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.510127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa8c8bf6-0a05-4860-9dae-b3a534298d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:30.511688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1017/2041] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:30 2021] DELETE /identity/v3/projects/159535c867da4520a3145f898c1ebb5c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:30.517307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.517805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.517903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.535534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:30.536683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:30.593351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1025/2042] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:30.601187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.601475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.601807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.619954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:30.621146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:30.629410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1018/2043] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:30.633380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.642642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fe14-3d0d-4a10-bd9b-7f7a97ab7d58 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.647384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.648312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.648601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.648876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.649611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:30.651533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.653397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.668512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1026/2044] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:30.672903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.683486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847b9e6-16f3-414a-871d-bdb36783769f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.688598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.689253 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.689537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.689810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.690512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.693220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.721350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1019/2045] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:30 2021] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:30.723165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.732717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ff76-c404-46e6-8b9b-b6df5e27199a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.790650 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.791250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.791536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.791811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.792528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.794545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.813108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1027/2046] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:30 2021] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:30.817887 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.827902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd766b7-146e-42f4-bf2a-3c209954adf8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.833043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.833684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.833965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.834247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.834972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.836594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.848331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1020/2047] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:30.852202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.861853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007553-254c-4e3e-a6ac-4b5697bd3559 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.867120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fb31c-7af8-4644-bf6e-5acc28571ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.867756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb31c-7af8-4644-bf6e-5acc28571ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.868038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb31c-7af8-4644-bf6e-5acc28571ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.868316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb31c-7af8-4644-bf6e-5acc28571ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.869074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fb31c-7af8-4644-bf6e-5acc28571ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.870661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fb31c-7af8-4644-bf6e-5acc28571ad6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.881333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1028/2048] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:30.884560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:30.894390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270619e-7ede-4763-8871-1e8d71aa1c26 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:30.899317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:30.900210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.900492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.900770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] PATH_INFO: `/v3/projects/5e1905f3a19645bc9055ba0a47b5b727/users/9429b7b8f2ab4e49bff3245848cfd625/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.916806 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1905f3a19645bc9055ba0a47b5b727, user_id=9429b7b8f2ab4e49bff3245848cfd625, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:30.919469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:30.934640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1021/2049] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:30 2021] PUT /identity/v3/projects/5e1905f3a19645bc9055ba0a47b5b727/users/9429b7b8f2ab4e49bff3245848cfd625/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:30.944660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:30.944949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:30.945223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:30.982774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] MFA Rules not processed for user `9429b7b8f2ab4e49bff3245848cfd625`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:30.984168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:31.062729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1029/2050] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:30 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:31.067842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.163370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029f1da-43a7-46c2-8b52-581ef7fee9da admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.167674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.168361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.169202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.169542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.170272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.172453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.202481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1022/2051] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:31 2021] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:31.203830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.221190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ca72-ac8a-4234-abcd-8a8adf06a2f2 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.290394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.291273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.291596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.291968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.292828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.294851 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.323352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1030/2052] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:31 2021] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:31.325190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.339102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322231c2-97c3-4fe4-875f-b454169ffb87 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.346905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.348312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.349277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.349277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.349938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.351651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.363987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1023/2053] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:31 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:31.371663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.382052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1854a8-9d9f-46f4-85d5-082ec0265d69 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.387771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.388755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.389030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.389315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] PATH_INFO: `/v3/projects/631f92b195a54780aeeda4055c9a8a78/users/c513fabead194a5daaf1a2871095f21b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.415367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f92b195a54780aeeda4055c9a8a78, user_id=c513fabead194a5daaf1a2871095f21b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.420029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.439099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1031/2054] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:31 2021] PUT /identity/v3/projects/631f92b195a54780aeeda4055c9a8a78/users/c513fabead194a5daaf1a2871095f21b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:31.442076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.452101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620605-4d6b-424d-a155-30effde73779 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.537907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd03c98-c0d2-43eb-bc6b-764dbeba8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.538969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03c98-c0d2-43eb-bc6b-764dbeba8f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.539424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03c98-c0d2-43eb-bc6b-764dbeba8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.539836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03c98-c0d2-43eb-bc6b-764dbeba8f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.540895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03c98-c0d2-43eb-bc6b-764dbeba8f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.543255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03c98-c0d2-43eb-bc6b-764dbeba8f67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.574814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1024/2055] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:31 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:31.575805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.587965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d700-16a6-42ad-82a7-421ef7f351a5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.595087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.596176 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.596462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.596774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] PATH_INFO: `/v3/projects/631f92b195a54780aeeda4055c9a8a78/users/c513fabead194a5daaf1a2871095f21b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.600051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f92b195a54780aeeda4055c9a8a78, user_id=c513fabead194a5daaf1a2871095f21b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.602696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.616463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1032/2056] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:31 2021] PUT /identity/v3/projects/631f92b195a54780aeeda4055c9a8a78/users/c513fabead194a5daaf1a2871095f21b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:31.627280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.627654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.627933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.653914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] MFA Rules not processed for user `c513fabead194a5daaf1a2871095f21b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:31.655141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:31.722812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1025/2057] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:31 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:31.732816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.734501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:31.788516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d9e-a01b-4064-ae9b-c9dcf446ada3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.792131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336c139-29ed-429d-ab7e-663d9b9aa758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:31.792754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c139-29ed-429d-ab7e-663d9b9aa758 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:31.793029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c139-29ed-429d-ab7e-663d9b9aa758 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:31.793349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c139-29ed-429d-ab7e-663d9b9aa758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:31.802802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336c139-29ed-429d-ab7e-663d9b9aa758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:31.804257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336c139-29ed-429d-ab7e-663d9b9aa758 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:31.813313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1033/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:31 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:31.931994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:31.994884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4866c57-f8e5-4e26-943a-d01a31a6c66a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:31.999864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:32.000755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:32.001039 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:32.001308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] PATH_INFO: `/v3/users/9429b7b8f2ab4e49bff3245848cfd625` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:32.002623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9429b7b8f2ab4e49bff3245848cfd625)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:32.004773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:32.060250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9429b7b8f2ab4e49bff3245848cfd625'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.070329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9429b7b8f2ab4e49bff3245848cfd625'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.071361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9429b7b8f2ab4e49bff3245848cfd625'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.094157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9429b7b8f2ab4e49bff3245848cfd625'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.104662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9429b7b8f2ab4e49bff3245848cfd625'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.110814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1026/2059] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:31 2021] DELETE /identity/v3/users/9429b7b8f2ab4e49bff3245848cfd625 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:32.116042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:32.116620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:32.117114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:32.140025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:32.141333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:32.260374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1034/2060] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:32.270711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:32.272675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:32.329258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492b11-876b-4eb7-90e0-826fe93244b7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:32.333229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:32.334089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:32.334500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:32.334631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:32.347898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:32.349363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:32.359892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1027/2061] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:32.765414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:32.766834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:32.790697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da06f-1b5d-4813-9b1c-3fa3fc5b63e0 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:32.797832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:32.798889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:32.799489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:32.799996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] PATH_INFO: `/v3/projects/5e1905f3a19645bc9055ba0a47b5b727` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:32.821237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1905f3a19645bc9055ba0a47b5b727)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:32.824314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:32.889428 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1905f3a19645bc9055ba0a47b5b727', 'request_id': 'req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.900080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1905f3a19645bc9055ba0a47b5b727', 'request_id': 'req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.909603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1905f3a19645bc9055ba0a47b5b727', 'request_id': 'req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.922550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] The token cache is being invalidate because project 5e1905f3a19645bc9055ba0a47b5b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:32.922839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.923666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:32.928865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1035/2062] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:32 2021] DELETE /identity/v3/projects/5e1905f3a19645bc9055ba0a47b5b727 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:32.929739 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:32.943095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c54a1-0ee5-4792-add6-c0f35d7c5136 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:33.029738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:33.030918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:33.031300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:33.031646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] PATH_INFO: `/v3/users/c513fabead194a5daaf1a2871095f21b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:33.032956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c513fabead194a5daaf1a2871095f21b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:33.034993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:33.095431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c513fabead194a5daaf1a2871095f21b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:33.102419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c513fabead194a5daaf1a2871095f21b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:33.103324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c513fabead194a5daaf1a2871095f21b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:33.116837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c513fabead194a5daaf1a2871095f21b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:33.125416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b12d80ae-9c76-455c-b708-4e42791b3d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c513fabead194a5daaf1a2871095f21b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:33.134431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1028/2063] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:32 2021] DELETE /identity/v3/users/c513fabead194a5daaf1a2871095f21b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:33.942081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:33.943787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:33.958667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f52b3-96c1-4aae-a510-f2f53cd901d9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.060915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.062203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.062651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.063114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] PATH_INFO: `/v3/projects/631f92b195a54780aeeda4055c9a8a78` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.064547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631f92b195a54780aeeda4055c9a8a78)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.067352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.143315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631f92b195a54780aeeda4055c9a8a78', 'request_id': 'req-56d12a2e-a666-4702-a923-afcd086fef89'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.152652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631f92b195a54780aeeda4055c9a8a78', 'request_id': 'req-56d12a2e-a666-4702-a923-afcd086fef89'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.161662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631f92b195a54780aeeda4055c9a8a78', 'request_id': 'req-56d12a2e-a666-4702-a923-afcd086fef89'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.179302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] The token cache is being invalidate because project 631f92b195a54780aeeda4055c9a8a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:34.179599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.180239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-56d12a2e-a666-4702-a923-afcd086fef89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.182102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1036/2064] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:33 2021] DELETE /identity/v3/projects/631f92b195a54780aeeda4055c9a8a78 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:34.188278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.189107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.189408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.211553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:34.213207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:34.279444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1029/2065] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:34.287082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.287388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.287668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.309873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:34.311154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:34.321163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1037/2066] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:34.326051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.337268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7529-7604-4fab-aa2b-5a6215dcfd78 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.343642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.344386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.344733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.345114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.346045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:34.346425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.348371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.380651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1030/2067] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:34.385471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.386199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.394568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:34.399778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd42a-9c88-4c3d-92ef-177fc6b6648e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.412753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.413505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.413848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.414183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.414761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125498c-5cb9-4a68-9183-4ec3b03e1a5c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.415551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.417723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.420074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.420946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.421233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.421514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] PATH_INFO: `/v3/users/54389a788c234ee0be611b8fe7406900` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.422753 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54389a788c234ee0be611b8fe7406900)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.425094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.454261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1038/2068] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:34 2021] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:34.455774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.480330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54389a788c234ee0be611b8fe7406900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.491708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54389a788c234ee0be611b8fe7406900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.493559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54389a788c234ee0be611b8fe7406900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.507240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54389a788c234ee0be611b8fe7406900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.516794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54389a788c234ee0be611b8fe7406900'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.525777 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1031/2069] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:34 2021] DELETE /identity/v3/users/54389a788c234ee0be611b8fe7406900 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:34.534801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92abce-44bc-44ea-a20f-76c45356c1d5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.603551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.604313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.605504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.605504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.606253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.608230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.667625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1039/2070] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:34 2021] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:34.674296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.675928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:34.711438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.714691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:34.721412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f184c1e-7263-44a1-bd7e-345162853f02 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.736093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.737063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.737361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.737699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.738832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.740504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.743178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3a0e3-bbb8-4629-a114-9bed0d505fa9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.754559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.755603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.756002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.756375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] PATH_INFO: `/v3/projects/1d3ef270d65d474f9150f140a3767576` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.758576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3ef270d65d474f9150f140a3767576)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.764566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.771805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1032/2071] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:34.772493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.791252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c5ef-4194-4c73-bf9d-b1b9ede045fa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.802017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.805052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.805360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.806219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.806991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.809778 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.828152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1033/2072] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:34.832326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.842091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3ef270d65d474f9150f140a3767576', 'request_id': 'req-e40079a7-d160-49ed-8358-cf9f1c35d0f0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.844172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff610e-9047-49d7-abdd-dbe1d6a3068b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.851250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3ef270d65d474f9150f140a3767576', 'request_id': 'req-e40079a7-d160-49ed-8358-cf9f1c35d0f0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.863972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3ef270d65d474f9150f140a3767576', 'request_id': 'req-e40079a7-d160-49ed-8358-cf9f1c35d0f0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.877621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] The token cache is being invalidate because project 1d3ef270d65d474f9150f140a3767576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:34.878514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.879472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:34.882254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1040/2073] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:34 2021] DELETE /identity/v3/projects/1d3ef270d65d474f9150f140a3767576 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:34.901292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:34.902829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:34.925500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db95ab0-bbfc-4b6e-a5c4-5217285c7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.926404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db95ab0-bbfc-4b6e-a5c4-5217285c7182 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.939812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db95ab0-bbfc-4b6e-a5c4-5217285c7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.940112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db95ab0-bbfc-4b6e-a5c4-5217285c7182 admin admin] PATH_INFO: `/v3/projects/870dd23de886482b9f866c10509d8a8e/users/3a397c7be255471f89f9218a12164ab7/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.966710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db95ab0-bbfc-4b6e-a5c4-5217285c7182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870dd23de886482b9f866c10509d8a8e, user_id=3a397c7be255471f89f9218a12164ab7, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.969286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db95ab0-bbfc-4b6e-a5c4-5217285c7182 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:34.979184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40079a7-d160-49ed-8358-cf9f1c35d0f0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:34.984794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:34.985908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:34.986343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:34.986689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] PATH_INFO: `/v3/users/3b5127fab25e4848bfcd59cb26d36bad` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:34.988645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5127fab25e4848bfcd59cb26d36bad)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:34.990819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.016100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1034/2074] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:34 2021] PUT /identity/v3/projects/870dd23de886482b9f866c10509d8a8e/users/3a397c7be255471f89f9218a12164ab7/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:35.017626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.017919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.018196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.057569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] MFA Rules not processed for user `3a397c7be255471f89f9218a12164ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:35.058825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:35.069183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5127fab25e4848bfcd59cb26d36bad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.069977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5127fab25e4848bfcd59cb26d36bad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.091975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5127fab25e4848bfcd59cb26d36bad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.095749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5127fab25e4848bfcd59cb26d36bad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.114688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5127fab25e4848bfcd59cb26d36bad'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.134473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1041/2075] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:34 2021] DELETE /identity/v3/users/3b5127fab25e4848bfcd59cb26d36bad => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:35.178022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.179878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:35.181933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1035/2076] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:35.265200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815507cc-b358-46f2-a801-efc31266fc3e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:35.271584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:35.272261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.272549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.272976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.273744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:35.276445 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.321337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1042/2077] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:35 2021] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:35.322822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.449849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42ed2-4ac7-4b0f-bbfd-e98c699a2f90 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:35.501730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.503701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:35.560834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:35.561514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.561794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.562068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.563553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:35.567214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.617849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1036/2078] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:35 2021] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:35.624248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.636632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9ee8d-e28c-4693-a471-72b580d111ab admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:35.641792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:35.642773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.642985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.643326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.644684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:35.646310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.663798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1037/2079] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:35.664740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.679245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59079f-7539-462b-acdc-3ba1fb61313f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:35.683297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadba26-c5ef-4c3c-8a41-d35e04b86599 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:35.685899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:35.686941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.687329 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.687611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] PATH_INFO: `/v3/projects/1546fe48c3c64835824315b81370f18b/users/378f608bd46942c8b2a1271f5f5938c3/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.691101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:35.691955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.692239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.692515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] PATH_INFO: `/v3/projects/4e2b5edb1bd448aa8072acfc47c23e9a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.694931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2b5edb1bd448aa8072acfc47c23e9a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:35.697572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.706138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1546fe48c3c64835824315b81370f18b, user_id=378f608bd46942c8b2a1271f5f5938c3, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:35.710288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.728019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1038/2080] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:35 2021] PUT /identity/v3/projects/1546fe48c3c64835824315b81370f18b/users/378f608bd46942c8b2a1271f5f5938c3/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:35.732332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.758073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2b5edb1bd448aa8072acfc47c23e9a', 'request_id': 'req-5a9f9774-e735-43a4-b2c7-5027cd1c7140'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.774290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2b5edb1bd448aa8072acfc47c23e9a', 'request_id': 'req-5a9f9774-e735-43a4-b2c7-5027cd1c7140'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.786925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2b5edb1bd448aa8072acfc47c23e9a', 'request_id': 'req-5a9f9774-e735-43a4-b2c7-5027cd1c7140'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.803203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] The token cache is being invalidate because project 4e2b5edb1bd448aa8072acfc47c23e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:35.804000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.804850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5a9f9774-e735-43a4-b2c7-5027cd1c7140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:35.808476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1043/2081] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:35 2021] DELETE /identity/v3/projects/4e2b5edb1bd448aa8072acfc47c23e9a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:35.814961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c31c0-365b-4ef2-98da-055cc6356dfb None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.815845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c31c0-365b-4ef2-98da-055cc6356dfb None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.816601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c31c0-365b-4ef2-98da-055cc6356dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.842028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-226c31c0-365b-4ef2-98da-055cc6356dfb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:35.843449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-226c31c0-365b-4ef2-98da-055cc6356dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:35.859991 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3131-07cd-4d23-b5e1-87b8e7c79fcf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:35.945923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:35.946604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.946956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.947333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.948211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:35.951647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:35.970772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1044/2082] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:35.977862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1039/2083] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:35.979297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:35.979760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:35.979847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:35.988367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:35.991267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:36.005429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:36.006654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:36.011230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acfdf8-07e7-47d1-b49e-88200d399ada admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.015913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1045/2084] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:36.016712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf901d71-3811-4f3d-aab6-01c30d624d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.017720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf901d71-3811-4f3d-aab6-01c30d624d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.018052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf901d71-3811-4f3d-aab6-01c30d624d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.018403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf901d71-3811-4f3d-aab6-01c30d624d5a admin admin] PATH_INFO: `/v3/projects/1546fe48c3c64835824315b81370f18b/users/378f608bd46942c8b2a1271f5f5938c3/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.021103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.021440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf901d71-3811-4f3d-aab6-01c30d624d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1546fe48c3c64835824315b81370f18b, user_id=378f608bd46942c8b2a1271f5f5938c3, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.025785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf901d71-3811-4f3d-aab6-01c30d624d5a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.035945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f743-27a3-481c-b47e-982d54bb4bac None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.042490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1040/2085] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:35 2021] PUT /identity/v3/projects/1546fe48c3c64835824315b81370f18b/users/378f608bd46942c8b2a1271f5f5938c3/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:36.057869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.058247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.058595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.096219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] MFA Rules not processed for user `378f608bd46942c8b2a1271f5f5938c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:36.097894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:36.131826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.132619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.133860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.134224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.135073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:36.135467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.137185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.154734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1046/2086] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:36.159265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.172383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88b0d-3876-4db7-a0e8-2c18a7976c86 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.181235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.182983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.183492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.184697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.185644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.188137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.239020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1041/2087] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:36 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:36.240563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.249171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1047/2088] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:36 2021] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:36.251510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.254694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:36.265980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1831a-87c6-4f88-b7f5-1c3781b6d889 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.351257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baff36-22a6-444b-8135-e0fa9ebf4ec6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.357030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.357785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.358129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.358480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.359379 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.360300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ef41-2066-4c9e-91df-5505eeac8fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.361345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ef41-2066-4c9e-91df-5505eeac8fcf service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.361640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.362075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ef41-2066-4c9e-91df-5505eeac8fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.362575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ef41-2066-4c9e-91df-5505eeac8fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.397453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1042/2089] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:36 2021] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:36.405159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.416239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22581-607a-4cb3-a0fd-4fe11a4f83ba admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.426554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.428613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.428613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.428613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.429137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.430840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.446705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1043/2090] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:36.452585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.478643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45916560-8950-45e7-997b-339b3aaf7052 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.497657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.498115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.498467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.498820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.499868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.505607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.530335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1044/2091] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:36.534385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.539928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ef41-2066-4c9e-91df-5505eeac8fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.541388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ef41-2066-4c9e-91df-5505eeac8fcf service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.555092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1048/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:36 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:36.557912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e63177-2fca-40c9-b636-bcbafc86b861 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.574222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.575362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.575718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.576121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] PATH_INFO: `/v3/projects/a2309262b1ae46edbda8fdfef79bf5e0/users/4c1b590422a84f2cb3ce785995a8254c/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.597129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2309262b1ae46edbda8fdfef79bf5e0, user_id=4c1b590422a84f2cb3ce785995a8254c, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.599965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:36.625513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1045/2093] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:36 2021] PUT /identity/v3/projects/a2309262b1ae46edbda8fdfef79bf5e0/users/4c1b590422a84f2cb3ce785995a8254c/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:36.642716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.643836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.644057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.716711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] MFA Rules not processed for user `4c1b590422a84f2cb3ce785995a8254c`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:36.717941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:36.891777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1049/2094] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:36 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:36.902171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:36.974301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f377f-bc88-48cf-8ed0-6158b758e8f0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:36.980338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:36.981078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:36.981366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:36.981815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:36.996151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:36.998331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:37.010750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1046/2095] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:36 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:37.035144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:37.059969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:37.116245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195654a-d6d2-48e3-95ae-89442786f285 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:37.122743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:37.124440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:37.125148 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:37.125623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] PATH_INFO: `/v3/users/4c1b590422a84f2cb3ce785995a8254c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:37.127175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1b590422a84f2cb3ce785995a8254c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:37.133203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:37.141053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bfa55-ad9e-49e5-95c9-bd496bf024f8 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:37.146829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:37.147828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:37.147998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:37.148274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] PATH_INFO: `/v3/users/3a397c7be255471f89f9218a12164ab7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:37.149950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a397c7be255471f89f9218a12164ab7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:37.151444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:37.188633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1b590422a84f2cb3ce785995a8254c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.189576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1b590422a84f2cb3ce785995a8254c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.199720 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a397c7be255471f89f9218a12164ab7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.202429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1b590422a84f2cb3ce785995a8254c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.203317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1b590422a84f2cb3ce785995a8254c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.207532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a397c7be255471f89f9218a12164ab7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.208212 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a397c7be255471f89f9218a12164ab7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.212830 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-6afecdc0-d18e-40ae-81ec-1f37bba6e578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1b590422a84f2cb3ce785995a8254c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.221515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a397c7be255471f89f9218a12164ab7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.231108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1050/2096] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:37 2021] DELETE /identity/v3/users/4c1b590422a84f2cb3ce785995a8254c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:37.234313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16849efc-aa2b-42d9-8126-3e035c22355f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a397c7be255471f89f9218a12164ab7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:37.235465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:37.235818 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:37.236095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:37.243118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1047/2097] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:37 2021] DELETE /identity/v3/users/3a397c7be255471f89f9218a12164ab7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:37.246786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:37.247140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:37.247437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:37.266794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:37.267960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:37.268094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:37.271404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:37.358412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1048/2098] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:37.368738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1051/2099] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:37.369958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:37.371852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:37.377147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:37.379325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:37.447238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea22f-2864-4a5a-b1c9-ea448a8b77e4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:37.451368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:37.452356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:37.452802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:37.453180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:37.464971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:37.466558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:37.478712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1049/2100] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:37.499743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6d955-f181-4aba-83ef-05210e1e8db8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:37.504673 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:37.505475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:37.505824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:37.506166 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:37.519170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:37.521111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:37.534251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1052/2101] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:37.929168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:37.930611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:37.990738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7082ff5-45e8-4362-b5cf-f1c023e43937 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:37.999687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.000548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.000824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.001336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] PATH_INFO: `/v3/projects/870dd23de886482b9f866c10509d8a8e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.003717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=870dd23de886482b9f866c10509d8a8e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.008552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.009227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.010470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.031144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb4262-426d-42c9-89dc-5708b8aadb69 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.043441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.046511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.046793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.047091 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] PATH_INFO: `/v3/projects/a2309262b1ae46edbda8fdfef79bf5e0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.048469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2309262b1ae46edbda8fdfef79bf5e0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.050750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.095299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870dd23de886482b9f866c10509d8a8e', 'request_id': 'req-77786a57-4999-425a-9d02-a3cdaccdb97b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.102113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870dd23de886482b9f866c10509d8a8e', 'request_id': 'req-77786a57-4999-425a-9d02-a3cdaccdb97b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.102306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2309262b1ae46edbda8fdfef79bf5e0', 'request_id': 'req-af7a7e34-b6a5-40c0-ba41-af25651634f2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.108815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2309262b1ae46edbda8fdfef79bf5e0', 'request_id': 'req-af7a7e34-b6a5-40c0-ba41-af25651634f2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.110935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870dd23de886482b9f866c10509d8a8e', 'request_id': 'req-77786a57-4999-425a-9d02-a3cdaccdb97b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.118172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2309262b1ae46edbda8fdfef79bf5e0', 'request_id': 'req-af7a7e34-b6a5-40c0-ba41-af25651634f2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.137074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] The token cache is being invalidate because project 870dd23de886482b9f866c10509d8a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:38.137328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.139078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] The token cache is being invalidate because project a2309262b1ae46edbda8fdfef79bf5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:38.139368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.140045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.140163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-af7a7e34-b6a5-40c0-ba41-af25651634f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.146015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1050/2102] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:37 2021] DELETE /identity/v3/projects/870dd23de886482b9f866c10509d8a8e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:38.148081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1053/2103] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:38 2021] DELETE /identity/v3/projects/a2309262b1ae46edbda8fdfef79bf5e0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:38.150013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.151601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.155294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314439-d6ad-4736-b5ea-a367310b0754 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.155771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314439-d6ad-4736-b5ea-a367310b0754 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.156385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314439-d6ad-4736-b5ea-a367310b0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.182678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-64314439-d6ad-4736-b5ea-a367310b0754 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:38.185854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-64314439-d6ad-4736-b5ea-a367310b0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.234103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786a57-4999-425a-9d02-a3cdaccdb97b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.248793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1054/2104] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:38.257835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.258118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.258393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.276505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:38.277691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.285557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1055/2105] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:38.289874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.295674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.296798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.297086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.297365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] PATH_INFO: `/v3/users/378f608bd46942c8b2a1271f5f5938c3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.298855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378f608bd46942c8b2a1271f5f5938c3)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.300597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.302393 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2790c-2679-4c46-ac54-215b937edaeb None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.307310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.307954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.308231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.308500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.309225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:38.309523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.311175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.327158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1056/2106] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:15:38.328362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.339616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a217f7-745a-423f-818e-c56a013b72b3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.344195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.344823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.345102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.345384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.346060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.348160 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.350034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378f608bd46942c8b2a1271f5f5938c3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.362940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378f608bd46942c8b2a1271f5f5938c3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.364701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378f608bd46942c8b2a1271f5f5938c3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.377228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378f608bd46942c8b2a1271f5f5938c3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.384814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1057/2107] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:38 2021] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:38.385916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.386051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378f608bd46942c8b2a1271f5f5938c3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.387540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.392185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1051/2108] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:38 2021] DELETE /identity/v3/users/378f608bd46942c8b2a1271f5f5938c3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:38.450397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93b00-f865-4a80-aa9f-a4f06486d124 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.526383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.527257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.527537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.527812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.528505 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.530413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.551868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1058/2109] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:38 2021] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:38.556144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.567125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027784-4786-4c24-9a54-3a69fb39a347 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.572470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.573131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.573533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.573812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.574575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.576195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.586696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1052/2110] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:38.590850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.600565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7223-debe-4fb8-b74f-6074deda5d03 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.606138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4004eb-34ae-451a-ac91-57499e3ed624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.606482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4004eb-34ae-451a-ac91-57499e3ed624 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.606762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4004eb-34ae-451a-ac91-57499e3ed624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.607059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4004eb-34ae-451a-ac91-57499e3ed624 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.607844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4004eb-34ae-451a-ac91-57499e3ed624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.610396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4004eb-34ae-451a-ac91-57499e3ed624 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.621828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1059/2111] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:38.625465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.638666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dd113-0193-4fd6-abbe-46e825b9ee34 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.644799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.645719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.646002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.646394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] PATH_INFO: `/v3/projects/8f0f7e74982140f2a2047ce729262110/users/e353240b64ff4209b20f7607410f6f7b/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.666968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0f7e74982140f2a2047ce729262110, user_id=e353240b64ff4209b20f7607410f6f7b, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.669821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.684905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1053/2112] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:38 2021] PUT /identity/v3/projects/8f0f7e74982140f2a2047ce729262110/users/e353240b64ff4209b20f7607410f6f7b/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:15:38.695901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb540-ca80-4065-98be-0198930dd294 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.696094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb540-ca80-4065-98be-0198930dd294 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.696502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb540-ca80-4065-98be-0198930dd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.728933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-670eb540-ca80-4065-98be-0198930dd294 None None] MFA Rules not processed for user `e353240b64ff4209b20f7607410f6f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:38.730310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-670eb540-ca80-4065-98be-0198930dd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.748533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.751126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.826112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1060/2113] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:38 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:38.838800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eb540-ca80-4065-98be-0198930dd294 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:38.840285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-670eb540-ca80-4065-98be-0198930dd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.851877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30415a6-6790-478f-b9ee-1d254d0609bb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.857479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.859270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.859721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.860410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] PATH_INFO: `/v3/projects/1546fe48c3c64835824315b81370f18b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.861769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1546fe48c3c64835824315b81370f18b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:38.864660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:38.907334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eb540-ca80-4065-98be-0198930dd294 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:38.921825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1546fe48c3c64835824315b81370f18b', 'request_id': 'req-8f851666-7b64-42fc-a25c-01c10908fe5e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.928644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1546fe48c3c64835824315b81370f18b', 'request_id': 'req-8f851666-7b64-42fc-a25c-01c10908fe5e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.936713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1546fe48c3c64835824315b81370f18b', 'request_id': 'req-8f851666-7b64-42fc-a25c-01c10908fe5e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.948125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] The token cache is being invalidate because project 1546fe48c3c64835824315b81370f18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:38.948411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.949059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f851666-7b64-42fc-a25c-01c10908fe5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:38.950625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1054/2114] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:38 2021] DELETE /identity/v3/projects/1546fe48c3c64835824315b81370f18b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:38.956656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2bee-76c1-4e24-8a0f-0e06222cc36c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.957044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2bee-76c1-4e24-8a0f-0e06222cc36c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.957325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2bee-76c1-4e24-8a0f-0e06222cc36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.964327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:38.964970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:38.965256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:38.965533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:38.967334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:38.975769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-498f2bee-76c1-4e24-8a0f-0e06222cc36c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:38.976953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-498f2bee-76c1-4e24-8a0f-0e06222cc36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:39.028361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.029880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.036789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1055/2115] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:39.039628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1061/2116] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:38 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:39.044468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.044695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.044973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.065244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:39.066502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:39.076606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1056/2117] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:39.080561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.092698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd614f-723f-4cd3-a9a8-3bf7d66c2a81 service glance] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.101490 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.102155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.102465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.102926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.103882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:39.104222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.105862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.119942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1062/2118] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:15:39.124158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.140129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e872-3d0a-49e2-a814-938e7337fc12 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.153038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.153708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.153997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.154262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.155000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.162401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.202715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.208052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1057/2119] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:39 2021] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:39.213456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9b41-7059-40d1-bbb2-5b1da87ff1b8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.285165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.285823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.286102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.286378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.287094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.289003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.324448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1063/2120] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:39 2021] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:39.328785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.340518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671b92b-d80e-4ca7-817b-284663f6ef73 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.350840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.352330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.352612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.352957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.353803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.355594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.367639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1058/2121] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:39 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:39.371910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.382312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87bb6-37e6-42c0-966c-f7b2c01ea47a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.387689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79704604-de72-4db8-97fa-eaf38e4131cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.388408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704604-de72-4db8-97fa-eaf38e4131cc admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.388693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704604-de72-4db8-97fa-eaf38e4131cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.389021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704604-de72-4db8-97fa-eaf38e4131cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.389756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704604-de72-4db8-97fa-eaf38e4131cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.391462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704604-de72-4db8-97fa-eaf38e4131cc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.401800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1064/2122] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:39.405623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.415623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618968-f590-4ffa-8b6a-0c41d2987f89 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.420920 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.421792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.422079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.422352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] PATH_INFO: `/v3/projects/9b04ace497f7403cb908d2381ac0cbd1/users/9f30bd885d314d00a0c875bcf9f80afb/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.438663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b04ace497f7403cb908d2381ac0cbd1, user_id=9f30bd885d314d00a0c875bcf9f80afb, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.441964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.455385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1059/2123] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:39 2021] PUT /identity/v3/projects/9b04ace497f7403cb908d2381ac0cbd1/users/9f30bd885d314d00a0c875bcf9f80afb/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:39.469228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.469228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.469228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.497630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] MFA Rules not processed for user `9f30bd885d314d00a0c875bcf9f80afb`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:39.500486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:39.595582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1065/2124] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:39.606752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:39.608669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:39.694209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749004-afe0-4ff6-8b5e-867aa32500be admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:39.700381 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:39.701045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:39.701326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:39.702187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:39.711820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:39.712758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:39.723022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1060/2125] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:39 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:42.068304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.069785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:42.134928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec6eaf-30d8-4871-b49e-196682d73b10 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.139512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.140372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.140653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.140927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] PATH_INFO: `/v3/users/63a8e0684f10464394e4f935d687cc48` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.142128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a8e0684f10464394e4f935d687cc48)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.144111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.190141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a8e0684f10464394e4f935d687cc48'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.190798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a8e0684f10464394e4f935d687cc48'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.202186 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a8e0684f10464394e4f935d687cc48'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.202852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a8e0684f10464394e4f935d687cc48'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.212969 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f603b0b4-5a6a-4748-9d8b-c9778e113357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a8e0684f10464394e4f935d687cc48'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.226642 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1066/2126] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:42 2021] DELETE /identity/v3/users/63a8e0684f10464394e4f935d687cc48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:42.403229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.414319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a067ea-ca2c-41a6-8a7f-d2607c6d2a2b service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.481415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.482261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.482555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.482819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] PATH_INFO: `/v3/projects/7efcbf12d6654bc68690363892415b77` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.484039 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efcbf12d6654bc68690363892415b77)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.485921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.538555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efcbf12d6654bc68690363892415b77', 'request_id': 'req-490dfa8a-551e-48df-904f-5c756cd536ea'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.545588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efcbf12d6654bc68690363892415b77', 'request_id': 'req-490dfa8a-551e-48df-904f-5c756cd536ea'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.553095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efcbf12d6654bc68690363892415b77', 'request_id': 'req-490dfa8a-551e-48df-904f-5c756cd536ea'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.565501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] The token cache is being invalidate because project 7efcbf12d6654bc68690363892415b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:42.565808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.566452 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-490dfa8a-551e-48df-904f-5c756cd536ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:42.568020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1061/2127] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:42 2021] DELETE /identity/v3/projects/7efcbf12d6654bc68690363892415b77 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:42.573751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.574044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.574329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.592620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:42.593813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:42.661351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1067/2128] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:42.710815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.711196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.711347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.729905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:42.731145 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:42.739344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1062/2129] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:42.743565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.752887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ff437-2d3e-4da2-b6a4-4d6e83322e32 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.757962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.758604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.758884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.759190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.760355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:42.760355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.761790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.774571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1068/2130] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:42.779735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.791149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42946-9f95-413f-8c18-90d6fa85d9c1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.803677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.804409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.804762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.805112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.806091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.808201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.835595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1063/2131] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:42 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:15:42.839869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.849588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a5f34-3014-440b-9828-4bb8f58b2ed0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.905207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.905863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.906146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.906421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.907143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.909051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.927912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1069/2132] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:42 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:42.932140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.942911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c698e12-489f-4611-a9dc-e28c16d0c174 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.947554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.948201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.948483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.948776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.949492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.951090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.961944 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1064/2133] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:15:42.965779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:42.975693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594d2d-52a0-4838-9216-a3c9b3dfaa9b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:42.980356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34f472-d58f-4d68-9cd6-2337b83cd454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:42.981015 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f472-d58f-4d68-9cd6-2337b83cd454 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:42.981292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f472-d58f-4d68-9cd6-2337b83cd454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:42.981567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f472-d58f-4d68-9cd6-2337b83cd454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:42.982402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34f472-d58f-4d68-9cd6-2337b83cd454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:42.984110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34f472-d58f-4d68-9cd6-2337b83cd454 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:42.995884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1070/2134] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:43.000157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:43.010624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a966c-6d39-4e23-8e0c-47bb7b8d6df2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:43.015566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:43.016460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:43.016745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:43.017024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] PATH_INFO: `/v3/projects/7ecea5c13a624ab8a3a445d3ede5fd77/users/0a133cb1175e4130902bbcdeaedd74f9/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:43.031662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecea5c13a624ab8a3a445d3ede5fd77, user_id=0a133cb1175e4130902bbcdeaedd74f9, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:43.034264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:43.046770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1065/2135] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:42 2021] PUT /identity/v3/projects/7ecea5c13a624ab8a3a445d3ede5fd77/users/0a133cb1175e4130902bbcdeaedd74f9/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:43.051783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e64c0-129d-4f3f-9270-2bae19418c22 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:43.052077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e64c0-129d-4f3f-9270-2bae19418c22 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:43.052361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e64c0-129d-4f3f-9270-2bae19418c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:43.070127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6f8e64c0-129d-4f3f-9270-2bae19418c22 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:43.071352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6f8e64c0-129d-4f3f-9270-2bae19418c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:43.130330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1071/2136] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:43.140313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:43.142064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:43.196305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1226a-f091-4a95-a265-97e5dbd07bc7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:43.199974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c798b-0841-40b0-a306-36d7b3fa7fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:43.200620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c798b-0841-40b0-a306-36d7b3fa7fcf service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:43.200902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c798b-0841-40b0-a306-36d7b3fa7fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:43.201175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c798b-0841-40b0-a306-36d7b3fa7fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:43.210322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c798b-0841-40b0-a306-36d7b3fa7fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:43.211764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c798b-0841-40b0-a306-36d7b3fa7fcf service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:43.220992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1066/2137] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:43.826685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8897-b157-4894-978c-720e4f63e87b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:43.826988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8897-b157-4894-978c-720e4f63e87b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:43.828938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8897-b157-4894-978c-720e4f63e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:43.861199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-068e8897-b157-4894-978c-720e4f63e87b None None] MFA Rules not processed for user `0a133cb1175e4130902bbcdeaedd74f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:43.862511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-068e8897-b157-4894-978c-720e4f63e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:43.934613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1072/2138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:43 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:43.946347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:43.947335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:43.947863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:43.966061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] MFA Rules not processed for user `0a133cb1175e4130902bbcdeaedd74f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:43.967315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:43.975076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1067/2139] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:43 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:49.450614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f36a4e-c781-4bc2-b617-d78d992240a1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:49.451101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f36a4e-c781-4bc2-b617-d78d992240a1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:49.451191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f36a4e-c781-4bc2-b617-d78d992240a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:49.469548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-99f36a4e-c781-4bc2-b617-d78d992240a1 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:49.470742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-99f36a4e-c781-4bc2-b617-d78d992240a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:49.523020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1073/2140] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:15:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:49.565002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:49.566371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:49.638918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b7628-2b65-4a74-8d24-1e9f3c10d70f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:49.644058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:49.644695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:49.645016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:49.645807 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:49.659305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:49.659305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:49.666635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1068/2141] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:15:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:50.226760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eeded-1ca7-4d71-9eee-5791462ac2b5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:50.227074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eeded-1ca7-4d71-9eee-5791462ac2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:50.227381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eeded-1ca7-4d71-9eee-5791462ac2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:50.245753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0e2eeded-1ca7-4d71-9eee-5791462ac2b5 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:50.246931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0e2eeded-1ca7-4d71-9eee-5791462ac2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:50.254035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1074/2142] 10.222.0.43 () {58 vars in 967 bytes} [Tue Dec 14 03:15:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:50.267118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:50.277153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6322db0-4d55-4846-b85b-439715a34106 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:50.282098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:50.282713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:50.282993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:50.283293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:50.291568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:50.293121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:50.300965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1069/2143] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:15:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:50.487865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe6d55-25ae-4e73-955e-dd616fdf56fc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:50.488613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe6d55-25ae-4e73-955e-dd616fdf56fc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:50.488724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe6d55-25ae-4e73-955e-dd616fdf56fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:50.506533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-85fe6d55-25ae-4e73-955e-dd616fdf56fc None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:50.507735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-85fe6d55-25ae-4e73-955e-dd616fdf56fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:50.514764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1075/2144] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:15:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:50.527237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:50.537719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9a275-e040-4167-a577-8e8192dcd506 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:50.542874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:50.543544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:50.543802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:50.544125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:50.552569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:50.554134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:50.561967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1070/2145] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:15:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:50.899655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:50.899938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:50.900206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:50.917944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:50.919207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:50.926270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1076/2146] 10.222.0.43 () {58 vars in 967 bytes} [Tue Dec 14 03:15:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:50.938763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:50.949422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676a228-8010-4eb6-8294-0726b938d0e2 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:50.954346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8084-033a-48e1-9022-531de6398361 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:50.954988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8084-033a-48e1-9022-531de6398361 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:50.955299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8084-033a-48e1-9022-531de6398361 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:50.955576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8084-033a-48e1-9022-531de6398361 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:50.964121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8084-033a-48e1-9022-531de6398361 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:50.966148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8084-033a-48e1-9022-531de6398361 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:50.974036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1071/2147] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:15:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:51.737698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:51.741258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:51.849809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e767-f46a-41f1-b898-947c18537a41 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:51.859812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3878a5-20a1-4807-bdc5-5eb0c5b8639c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:51.860528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3878a5-20a1-4807-bdc5-5eb0c5b8639c service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:51.860817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3878a5-20a1-4807-bdc5-5eb0c5b8639c service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:51.861086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3878a5-20a1-4807-bdc5-5eb0c5b8639c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:51.871084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3878a5-20a1-4807-bdc5-5eb0c5b8639c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:51.872734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3878a5-20a1-4807-bdc5-5eb0c5b8639c service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:51.882889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1077/2148] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:51 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:15:52.993957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8084-033a-48e1-9022-531de6398361 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:52.996116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-862c8084-033a-48e1-9022-531de6398361 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:53.012244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8084-033a-48e1-9022-531de6398361 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.017806 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.018818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.018974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.019505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] PATH_INFO: `/v3/users/e8f5b824c4204f5da272b60d907bb2a6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.021291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f5b824c4204f5da272b60d907bb2a6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.023260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.074948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f5b824c4204f5da272b60d907bb2a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.085740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f5b824c4204f5da272b60d907bb2a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.086744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f5b824c4204f5da272b60d907bb2a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.100169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f5b824c4204f5da272b60d907bb2a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.107146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f5b824c4204f5da272b60d907bb2a6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.112913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1072/2149] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:15:52 2021] DELETE /identity/v3/users/e8f5b824c4204f5da272b60d907bb2a6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:53.118217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.118707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.118799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.137682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:53.138888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:53.194512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1078/2150] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:53.204151 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.205508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:53.262686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54226fb0-9d44-43e4-8316-f5ce80f20a6c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.266427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29feb-8c6a-46b2-b617-709f2383bbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.267061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29feb-8c6a-46b2-b617-709f2383bbaa service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.267369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29feb-8c6a-46b2-b617-709f2383bbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.267640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29feb-8c6a-46b2-b617-709f2383bbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.277048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29feb-8c6a-46b2-b617-709f2383bbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.278534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29feb-8c6a-46b2-b617-709f2383bbaa service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.287663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1073/2151] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:15:53.451412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.453220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:53.477314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c762a0-4e97-4dc0-9e87-c6c1f83225dc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.484067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.484884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.485400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.485621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] PATH_INFO: `/v3/projects/722b58145d434e1181ebd90e63eb1255` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.486834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=722b58145d434e1181ebd90e63eb1255)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.489893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.549463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722b58145d434e1181ebd90e63eb1255', 'request_id': 'req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.557640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722b58145d434e1181ebd90e63eb1255', 'request_id': 'req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.565207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722b58145d434e1181ebd90e63eb1255', 'request_id': 'req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.576220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] The token cache is being invalidate because project 722b58145d434e1181ebd90e63eb1255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:15:53.576500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.577116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f3d3da3b-ecba-4e13-8fe6-4fa91694e99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:15:53.578663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1079/2152] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:15:53 2021] DELETE /identity/v3/projects/722b58145d434e1181ebd90e63eb1255 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:53.585126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.585401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.585673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.610209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:53.611451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:53.687435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1074/2153] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:53.695568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.695845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.696306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.715104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:53.716312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:53.724256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1080/2154] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:15:53.728406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.737751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086225-d836-4203-b4f2-09936cfa1733 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.743523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.744257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.744607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.744951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.745837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:15:53.746197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.747914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.761672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1075/2155] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:15:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:15:53.765968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.775287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199d923-8d4b-41c8-b64e-d4dfde4be3a0 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.780987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.781810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.782322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.785812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.786535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.788832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.816528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1081/2156] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:15:53 2021] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:53.821330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.830931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc17282-9294-45bb-86b0-376eb72455fb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.904075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.904824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.905230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.905514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.906624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.908311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.934680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1076/2157] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:15:53 2021] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:15:53.938984 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.950832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04614672-32df-45b7-aefd-a76f918fc7b3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.959454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.960130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.960410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.960687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.961426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.963558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:53.976933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1082/2158] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:53.980047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:53.991201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ff601-5f09-43f6-a844-b0a32f6d1dbf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:53.995954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d771b2-8b30-416b-8694-944b6f436d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:53.996615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d771b2-8b30-416b-8694-944b6f436d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:53.996898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d771b2-8b30-416b-8694-944b6f436d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:53.997179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d771b2-8b30-416b-8694-944b6f436d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:53.997918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d771b2-8b30-416b-8694-944b6f436d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:53.999558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d771b2-8b30-416b-8694-944b6f436d1e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:54.009530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1077/2159] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:15:54.013649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:54.023792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb9b7b-4b56-4682-bd9c-584554b7efd6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:54.028732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:54.029608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:54.029895 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:54.030173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] PATH_INFO: `/v3/projects/5d6b67a0a79f410abcade4cf7ea0b9d9/users/f2848516796f4b5495bee5599660cec0/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:54.045218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6b67a0a79f410abcade4cf7ea0b9d9, user_id=f2848516796f4b5495bee5599660cec0, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:54.047866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:54.060718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1083/2160] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:15:54 2021] PUT /identity/v3/projects/5d6b67a0a79f410abcade4cf7ea0b9d9/users/f2848516796f4b5495bee5599660cec0/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:15:54.071261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:54.071559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:54.071834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:54.100828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] MFA Rules not processed for user `f2848516796f4b5495bee5599660cec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:15:54.102055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:54.173770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1078/2161] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:15:54 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:15:54.180950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:15:54.182705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:15:54.238313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871171-0c9a-410e-ba39-40d78aa757cd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:15:54.242891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22e7c-d34e-44ef-aa74-c1b86c99a9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:15:54.243562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22e7c-d34e-44ef-aa74-c1b86c99a9df service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:15:54.244006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22e7c-d34e-44ef-aa74-c1b86c99a9df service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:15:54.244292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22e7c-d34e-44ef-aa74-c1b86c99a9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:15:54.253264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22e7c-d34e-44ef-aa74-c1b86c99a9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:15:54.254836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22e7c-d34e-44ef-aa74-c1b86c99a9df service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:15:54.263988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1084/2162] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:15:54 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:16:36.181642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:36.183094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:36.256730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39ba4-5870-4067-8175-1106188c5574 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:36.262840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:36.263760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:36.264841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:36.265133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] PATH_INFO: `/v3/users/b6a28d5a77f645dc94149e9a64bdbed4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:36.267191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a28d5a77f645dc94149e9a64bdbed4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:36.269188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:36.322222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a28d5a77f645dc94149e9a64bdbed4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.329794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a28d5a77f645dc94149e9a64bdbed4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.330509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a28d5a77f645dc94149e9a64bdbed4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.342899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a28d5a77f645dc94149e9a64bdbed4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.351373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a28d5a77f645dc94149e9a64bdbed4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.357922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1079/2163] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:16:36 2021] DELETE /identity/v3/users/b6a28d5a77f645dc94149e9a64bdbed4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:36.364064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:36.364594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:36.364699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:36.384033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:36.385261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:36.449778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1085/2164] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:16:36.459943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:36.461400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:36.525001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467f6ac-1733-401d-91b5-1479e7f3bdec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:36.529328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343168b1-52dd-471b-a722-f2c34cd6957d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:36.530269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343168b1-52dd-471b-a722-f2c34cd6957d service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:36.530755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343168b1-52dd-471b-a722-f2c34cd6957d service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:36.531267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343168b1-52dd-471b-a722-f2c34cd6957d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:36.541567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343168b1-52dd-471b-a722-f2c34cd6957d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:36.543389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343168b1-52dd-471b-a722-f2c34cd6957d service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:36.555453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1080/2165] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:16:36.836268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:36.838352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:36.850918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2071a-5313-4848-bbe2-e47db1762a74 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:36.866489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:36.867392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:36.867672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:36.867945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] PATH_INFO: `/v3/projects/663addf663794cdb9f10a8bfe14d990d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:36.869361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] RBAC: Authorizing `identity:delete_project(project_id=663addf663794cdb9f10a8bfe14d990d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:36.871370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:36.930446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663addf663794cdb9f10a8bfe14d990d', 'request_id': 'req-9a8f5808-61ee-41e1-b990-819cabe3764a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.937303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663addf663794cdb9f10a8bfe14d990d', 'request_id': 'req-9a8f5808-61ee-41e1-b990-819cabe3764a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.946422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663addf663794cdb9f10a8bfe14d990d', 'request_id': 'req-9a8f5808-61ee-41e1-b990-819cabe3764a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.957331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] The token cache is being invalidate because project 663addf663794cdb9f10a8bfe14d990d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:16:36.957538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.958169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9a8f5808-61ee-41e1-b990-819cabe3764a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:36.959828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1086/2166] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:16:36 2021] DELETE /identity/v3/projects/663addf663794cdb9f10a8bfe14d990d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:16:36.965608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:36.965899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:36.966175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:36.987137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:36.989181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:37.049715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1081/2167] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:37.057455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.057748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.058023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.076519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:37.077708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:37.086140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1087/2168] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:37.090322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.100170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8c8a6-597c-4d37-9ef0-75f745115d7d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.105047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.105703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.105985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.106268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.107181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:16:37.107493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.109156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.121178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1082/2169] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:16:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:16:37.125459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.134529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26d637-2549-4446-9e03-2e637738d7bc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.139222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.139858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.140140 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.140415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.141153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.143065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.172147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1088/2170] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:16:37 2021] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:37.173101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.183746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576137-0cab-44f0-aa97-16ed2d1046aa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.237679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.238554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.238837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.239144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.239854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.241793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.260532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1083/2171] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:16:37 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:37.264590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.275226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d48d2-f74e-4db2-aa06-4e7bdd29639f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.279990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.280798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.281080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.281356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.282084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.283723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.294394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1089/2172] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:37.298263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.308051 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982318e9-f648-4d8d-b178-611f0e9c1c30 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.312661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf49bb-d760-47a2-a18b-3f5adc214243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.313304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf49bb-d760-47a2-a18b-3f5adc214243 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.313586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf49bb-d760-47a2-a18b-3f5adc214243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.313861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf49bb-d760-47a2-a18b-3f5adc214243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.314594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf49bb-d760-47a2-a18b-3f5adc214243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.316249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf49bb-d760-47a2-a18b-3f5adc214243 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.325779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1084/2173] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:37.329598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.339572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313ee6-ead4-419d-8f7f-083de84326a5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.344548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.345398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.345671 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.345943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] PATH_INFO: `/v3/projects/ee285a93d443472aa894db88321f757e/users/ba0d1dd228ee455797bd1821a94380fd/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.361035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee285a93d443472aa894db88321f757e, user_id=ba0d1dd228ee455797bd1821a94380fd, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.364004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.377294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1090/2174] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:16:37 2021] PUT /identity/v3/projects/ee285a93d443472aa894db88321f757e/users/ba0d1dd228ee455797bd1821a94380fd/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:37.388498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.388790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.389069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.416053 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] MFA Rules not processed for user `ba0d1dd228ee455797bd1821a94380fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:37.417265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:37.487518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1085/2175] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:37 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:37.499643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:37.501307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:37.556149 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb8ab3-9a6f-487c-8dde-8af96592793f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:37.560108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b0077-e57e-4bd1-92e3-937ec4066268 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:37.560736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b0077-e57e-4bd1-92e3-937ec4066268 service glance] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:37.561014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b0077-e57e-4bd1-92e3-937ec4066268 service glance] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:37.561285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b0077-e57e-4bd1-92e3-937ec4066268 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:37.570117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b0077-e57e-4bd1-92e3-937ec4066268 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:37.571595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b0077-e57e-4bd1-92e3-937ec4066268 service glance] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:37.580758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1091/2176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:37 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:16:40.216918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:40.218482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:40.290138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93e159-67b3-40f3-b03d-8982a593fa14 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:40.294689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:40.295572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.295852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.296123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] PATH_INFO: `/v3/users/f2848516796f4b5495bee5599660cec0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.297356 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2848516796f4b5495bee5599660cec0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:40.299299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:40.344343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2848516796f4b5495bee5599660cec0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.352026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2848516796f4b5495bee5599660cec0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.352689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2848516796f4b5495bee5599660cec0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.365641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2848516796f4b5495bee5599660cec0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.373130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2848516796f4b5495bee5599660cec0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.379266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1086/2177] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:16:40 2021] DELETE /identity/v3/users/f2848516796f4b5495bee5599660cec0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:40.383523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.383999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.384092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.401836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:40.403060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:40.462699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1092/2178] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:40.472542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:40.474368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:40.540707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb17a74-f890-4782-a028-0272c315da03 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:40.545906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:40.546976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.547556 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.548013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.561585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:40.563310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:40.574287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1087/2179] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:16:40.844096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:40.847392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:40.848576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:40.850041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:40.860385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3ac07-312b-4b89-86f0-30d316ed65ab None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:40.862413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316935-3e41-4337-ba6d-b2bb2ad3672a service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:40.866522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:40.867519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.867659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:40.867945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.868250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] PATH_INFO: `/v3/projects/5d6b67a0a79f410abcade4cf7ea0b9d9` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.868392 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.868680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.868950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] PATH_INFO: `/v3/users/9f30bd885d314d00a0c875bcf9f80afb` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.870213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f30bd885d314d00a0c875bcf9f80afb)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:40.870313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6b67a0a79f410abcade4cf7ea0b9d9)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:40.872865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:40.875772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:40.923997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f30bd885d314d00a0c875bcf9f80afb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.924683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6b67a0a79f410abcade4cf7ea0b9d9', 'request_id': 'req-038ff94f-a170-4fba-92b1-253c76af14e0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.931382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f30bd885d314d00a0c875bcf9f80afb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.931517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6b67a0a79f410abcade4cf7ea0b9d9', 'request_id': 'req-038ff94f-a170-4fba-92b1-253c76af14e0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.932062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f30bd885d314d00a0c875bcf9f80afb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.939131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6b67a0a79f410abcade4cf7ea0b9d9', 'request_id': 'req-038ff94f-a170-4fba-92b1-253c76af14e0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.944326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f30bd885d314d00a0c875bcf9f80afb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.950967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] The token cache is being invalidate because project 5d6b67a0a79f410abcade4cf7ea0b9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:16:40.951473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.952115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-038ff94f-a170-4fba-92b1-253c76af14e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.952600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3ebfef13-239a-4796-a84e-7b822abd0028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f30bd885d314d00a0c875bcf9f80afb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:40.953750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1093/2180] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:16:40 2021] DELETE /identity/v3/projects/5d6b67a0a79f410abcade4cf7ea0b9d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:40.959824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1088/2181] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:16:40 2021] DELETE /identity/v3/users/9f30bd885d314d00a0c875bcf9f80afb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:16:40.960187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74121b-f310-4dc5-910a-7a96f24d3fbc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.960500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74121b-f310-4dc5-910a-7a96f24d3fbc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.960776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74121b-f310-4dc5-910a-7a96f24d3fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.963978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:40.964213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:40.964490 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:40.978600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dd74121b-f310-4dc5-910a-7a96f24d3fbc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:40.980069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dd74121b-f310-4dc5-910a-7a96f24d3fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:40.981185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:40.982341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.038221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1094/2182] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:16:41.047600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1089/2183] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:41.047746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.047746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.047746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.054761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.056114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.064892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:41.066060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.074422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1095/2184] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:16:41.078422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.086873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426d34-7234-428d-8b51-d03db9b58aec None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.091733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.092388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.092649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.092925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.093656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:16:41.093964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.095593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.106816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1096/2185] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:16:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:16:41.110450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9a07-c0e8-4f88-93a6-9d95d40fdf5c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.111064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.115594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.115594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.115594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.116540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.125729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.125912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880d13f-688f-4177-a62b-1dbf6a30695b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.127251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.136729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.136729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.136729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.137102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.137535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1090/2186] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:16:41.137853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.139935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.173182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1097/2187] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:16:41.177640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.187325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d50e9-3be9-45d5-a351-c93ad12221e7 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.255723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.256317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.256397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.256650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.257377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.259280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.287202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1091/2188] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:41.288540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.299171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297694-ad94-421f-8926-e0705612ec3f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.305992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.306658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.306937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.307256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.309209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.310264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.322362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1098/2189] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:41.326651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.342448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d40f5-a681-467c-b782-8afc3f74078b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.349149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d60b-4d5e-4bde-b1bf-7517d1a1002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.349820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d60b-4d5e-4bde-b1bf-7517d1a1002b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.350101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d60b-4d5e-4bde-b1bf-7517d1a1002b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.350372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d60b-4d5e-4bde-b1bf-7517d1a1002b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.351127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d60b-4d5e-4bde-b1bf-7517d1a1002b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.352709 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d60b-4d5e-4bde-b1bf-7517d1a1002b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.363825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1092/2190] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:41.367827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.380876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1b88-8372-40ae-87e7-60b631752235 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.386181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.387695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.388143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.388424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] PATH_INFO: `/v3/projects/bc2e5ee76edf4e358f418773bf824ed7/users/f1d620fa9da54f588f753b3c497f00c7/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.415684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2e5ee76edf4e358f418773bf824ed7, user_id=f1d620fa9da54f588f753b3c497f00c7, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.418385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.433210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1099/2191] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:16:41 2021] PUT /identity/v3/projects/bc2e5ee76edf4e358f418773bf824ed7/users/f1d620fa9da54f588f753b3c497f00c7/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:41.438260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.438740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.439120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.459970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:41.461501 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.516244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.518647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.544651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1093/2192] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:41.573060 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.602955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52fad-b93a-4821-80df-cda867ed55f4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.611074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.612402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.612934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.613781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] PATH_INFO: `/v3/projects/9b04ace497f7403cb908d2381ac0cbd1` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.615563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b04ace497f7403cb908d2381ac0cbd1)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.617690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.656995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523d138-45b1-4d2f-a1ab-7da621ecbcd5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.664529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6cfb-df98-4aad-b1e4-6ada72cf3599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.665559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6cfb-df98-4aad-b1e4-6ada72cf3599 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.665938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6cfb-df98-4aad-b1e4-6ada72cf3599 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.666303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6cfb-df98-4aad-b1e4-6ada72cf3599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.680045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6cfb-df98-4aad-b1e4-6ada72cf3599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.684553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6cfb-df98-4aad-b1e4-6ada72cf3599 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.687322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b04ace497f7403cb908d2381ac0cbd1', 'request_id': 'req-c1b541cd-5935-46c0-ae93-53e4792b7dcc'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:41.693744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b04ace497f7403cb908d2381ac0cbd1', 'request_id': 'req-c1b541cd-5935-46c0-ae93-53e4792b7dcc'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:41.695454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1094/2193] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:16:41.702468 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b04ace497f7403cb908d2381ac0cbd1', 'request_id': 'req-c1b541cd-5935-46c0-ae93-53e4792b7dcc'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:41.715135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] The token cache is being invalidate because project 9b04ace497f7403cb908d2381ac0cbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:16:41.715541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:41.717108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c1b541cd-5935-46c0-ae93-53e4792b7dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:16:41.720118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1100/2194] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:16:41 2021] DELETE /identity/v3/projects/9b04ace497f7403cb908d2381ac0cbd1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:41.727582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.727967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.728300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.750250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:41.751645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.817069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1095/2195] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:41.825078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.825371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.825677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.851542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:41.852871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:41.863372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1101/2196] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:41.866331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.877650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80f5d-5c50-4018-9e4d-a852708b6a3f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.882908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.883611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.883890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.884194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.884925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:16:41.885222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.886987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.901529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1096/2197] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:16:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:16:41.905565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.915382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b569e3-ba83-4b67-bf6c-e4362cbf989c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:41.920110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:41.920852 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:41.921218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:41.921498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:41.922206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:41.924129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:41.954159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1102/2198] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:41.966700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:41.979250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed1372-457e-4b95-b710-7d12fc7d88e9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:42.056825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:42.057568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:42.057856 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:42.058135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:42.059032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:42.062585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:42.089007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1097/2199] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:16:41 2021] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:42.090292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:42.100900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da99841-47e4-421e-b8b2-2f6b01cd356a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:42.105577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:42.106260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:42.106542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:42.106819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:42.107623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:42.109212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:42.120095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1103/2200] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:42.124093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:42.134696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6a3f3-afe8-425c-b83e-379aa7c15c03 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:42.139488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e7dea-3202-4307-8fba-62dc28af6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:42.140196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e7dea-3202-4307-8fba-62dc28af6294 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:42.140476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e7dea-3202-4307-8fba-62dc28af6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:42.140750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e7dea-3202-4307-8fba-62dc28af6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:42.141516 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e7dea-3202-4307-8fba-62dc28af6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:42.143110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e7dea-3202-4307-8fba-62dc28af6294 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:42.156759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1098/2201] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:42.158373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:42.169377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce575-a9e6-4c84-ac82-d20b9e25913c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:42.174064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:42.174935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:42.175240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:42.175559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] PATH_INFO: `/v3/projects/88a6d9c2f5a940de9042e2c036cfb855/users/1e8db286bfb5459da8906cd54c4722fa/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:42.195628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a6d9c2f5a940de9042e2c036cfb855, user_id=1e8db286bfb5459da8906cd54c4722fa, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:42.198353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:42.211526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1104/2202] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:16:42 2021] PUT /identity/v3/projects/88a6d9c2f5a940de9042e2c036cfb855/users/1e8db286bfb5459da8906cd54c4722fa/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:42.222952 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e67e59-fcac-45a9-91d2-412b189eda5a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:42.223279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e67e59-fcac-45a9-91d2-412b189eda5a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:42.223559 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e67e59-fcac-45a9-91d2-412b189eda5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:42.252538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f6e67e59-fcac-45a9-91d2-412b189eda5a None None] MFA Rules not processed for user `1e8db286bfb5459da8906cd54c4722fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:42.254353 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f6e67e59-fcac-45a9-91d2-412b189eda5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:42.351530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1099/2203] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:42 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:42.363757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:42.365560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:42.437084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0851d-2f79-4bfa-a7ff-b0a34abff01b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:42.440834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:42.442074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:42.442351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:42.442785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:42.459552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:42.460991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:42.470238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1105/2204] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:42 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:16:46.848574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:46.849143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:46.849143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:46.885363 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] MFA Rules not processed for user `f1d620fa9da54f588f753b3c497f00c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:46.886617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:46.957424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1100/2205] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:46 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:46.962459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:46.964616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:47.058423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be30e-a8b7-4243-9423-4c68c7fec157 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:47.071240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:47.072116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:47.072472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:47.072973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:47.073879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:47.077139 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:47.104890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1106/2206] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:16:46 2021] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:47.108953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:47.120207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8a85-1ff6-4ed4-8536-b0d7d8868f82 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:47.175258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:47.176444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:47.176730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:47.177027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:47.177704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:47.179653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:47.198831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1101/2207] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:16:47 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:16:47.202822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:47.213796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e884f-572e-4c7f-be84-55f1a7139b32 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:47.218569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:47.219261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:47.219546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:47.219820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:47.220556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:47.222672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:47.235915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1107/2208] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:16:47.240812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:47.250740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823081e6-640a-4627-a3aa-deb78a63e660 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:47.255359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:47.256217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:47.256499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:47.256772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] PATH_INFO: `/v3/projects/574a0ff076ae428999f919b34df1c6c8/users/1754713b43f34d238d6503887a5e2e14/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:47.270766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574a0ff076ae428999f919b34df1c6c8, user_id=1754713b43f34d238d6503887a5e2e14, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:47.273404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:47.286763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1102/2209] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:16:47 2021] PUT /identity/v3/projects/574a0ff076ae428999f919b34df1c6c8/users/1754713b43f34d238d6503887a5e2e14/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:47.290708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:47.301188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8a60d-d64e-4762-87f5-7b7b50b6c56d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:47.355873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e71a-bc78-439c-b9e7-fcff387aaff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:47.356529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e71a-bc78-439c-b9e7-fcff387aaff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:47.356814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e71a-bc78-439c-b9e7-fcff387aaff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:47.357093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e71a-bc78-439c-b9e7-fcff387aaff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:47.357819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e71a-bc78-439c-b9e7-fcff387aaff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:47.359466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e71a-bc78-439c-b9e7-fcff387aaff8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:47.370037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1108/2210] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:16:47.373918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:47.384468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5a07-e9b6-450e-8ed6-db6d815e4340 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:47.389507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:47.390711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:47.390989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:47.391295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] PATH_INFO: `/v3/projects/574a0ff076ae428999f919b34df1c6c8/users/1754713b43f34d238d6503887a5e2e14/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:47.393396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574a0ff076ae428999f919b34df1c6c8, user_id=1754713b43f34d238d6503887a5e2e14, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:47.396093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:47.406403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1103/2211] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:16:47 2021] PUT /identity/v3/projects/574a0ff076ae428999f919b34df1c6c8/users/1754713b43f34d238d6503887a5e2e14/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:16:51.776742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00190d6f-bb45-4cb0-8da9-c4bd70045fa5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:51.777336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00190d6f-bb45-4cb0-8da9-c4bd70045fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:51.777336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00190d6f-bb45-4cb0-8da9-c4bd70045fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:51.808382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-00190d6f-bb45-4cb0-8da9-c4bd70045fa5 None None] MFA Rules not processed for user `1754713b43f34d238d6503887a5e2e14`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:51.809664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-00190d6f-bb45-4cb0-8da9-c4bd70045fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:51.899009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1109/2212] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:51.908147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:51.910951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:52.016337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518beb8-5668-4512-b6f8-6ba9e517e912 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:52.021712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:52.022370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:52.022657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:52.022938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:52.091672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:52.096639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:52.116263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1104/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:16:51 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:16:52.309841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497949-d03e-4a4c-ba9d-882a3d72e147 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:52.310229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497949-d03e-4a4c-ba9d-882a3d72e147 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:52.310584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497949-d03e-4a4c-ba9d-882a3d72e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:52.330636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-51497949-d03e-4a4c-ba9d-882a3d72e147 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:52.333029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-51497949-d03e-4a4c-ba9d-882a3d72e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:52.412674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1110/2214] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:16:52 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:16:52.462415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:16:52.468457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:52.558023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568a41-7e4a-45e3-b129-3fdfc2121c7f service glance] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:16:52.564153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830aeec-91b4-47fe-bc27-559086b5627b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:16:52.564817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830aeec-91b4-47fe-bc27-559086b5627b service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:52.565101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830aeec-91b4-47fe-bc27-559086b5627b service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:52.565376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830aeec-91b4-47fe-bc27-559086b5627b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:52.576075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830aeec-91b4-47fe-bc27-559086b5627b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:16:52.577857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830aeec-91b4-47fe-bc27-559086b5627b service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:16:52.586740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1105/2215] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:16:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:16:53.211562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:16:53.212051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:16:53.212135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:16:53.230760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] MFA Rules not processed for user `0a133cb1175e4130902bbcdeaedd74f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:16:53.231936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:16:53.310043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1111/2216] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:03.122827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684226-1a7e-4ca3-98d9-bb70ca065646 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:03.124216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684226-1a7e-4ca3-98d9-bb70ca065646 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:03.124792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684226-1a7e-4ca3-98d9-bb70ca065646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:03.148821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5a684226-1a7e-4ca3-98d9-bb70ca065646 None None] MFA Rules not processed for user `f1d620fa9da54f588f753b3c497f00c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:03.150203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5a684226-1a7e-4ca3-98d9-bb70ca065646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:03.162413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1106/2217] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:03 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:09.290693 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:09.385769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c08d4-6340-4f8e-94e7-fef98dde423a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:09.401278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:09.402341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:09.403059 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:09.403268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] PATH_INFO: `/v3/users/1e8db286bfb5459da8906cd54c4722fa` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:09.405369 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8db286bfb5459da8906cd54c4722fa)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:09.408097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:09.494662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8db286bfb5459da8906cd54c4722fa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:09.495375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8db286bfb5459da8906cd54c4722fa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:09.507722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8db286bfb5459da8906cd54c4722fa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:09.508385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8db286bfb5459da8906cd54c4722fa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:09.516103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8db286bfb5459da8906cd54c4722fa'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:09.528284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1112/2218] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:17:09 2021] DELETE /identity/v3/users/1e8db286bfb5459da8906cd54c4722fa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:09.532876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:09.533373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:09.533474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:09.551346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:09.552775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:09.610235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1107/2219] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:17:09.621614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:09.623210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:09.683947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4703-5f91-43b3-9abe-d222512e0ee5 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:09.687589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf115af-a564-42be-975f-470358d4d923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:09.688220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf115af-a564-42be-975f-470358d4d923 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:09.688497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf115af-a564-42be-975f-470358d4d923 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:09.688770 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf115af-a564-42be-975f-470358d4d923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:09.698861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf115af-a564-42be-975f-470358d4d923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:09.700336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf115af-a564-42be-975f-470358d4d923 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:09.710415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1113/2220] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:10.045791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:10.047242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:10.076208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2c9d-1408-49cc-968a-4fd18748b447 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:10.081287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:10.081570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:10.081944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:10.103940 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:10.104948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:10.105362 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:10.105849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] PATH_INFO: `/v3/projects/88a6d9c2f5a940de9042e2c036cfb855` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:10.108086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a6d9c2f5a940de9042e2c036cfb855)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:10.110043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:10.123776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:10.132800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:10.195877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a6d9c2f5a940de9042e2c036cfb855', 'request_id': 'req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:10.204524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a6d9c2f5a940de9042e2c036cfb855', 'request_id': 'req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:10.213472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a6d9c2f5a940de9042e2c036cfb855', 'request_id': 'req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:10.227844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1114/2221] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:17:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:17:10.228142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] The token cache is being invalidate because project 88a6d9c2f5a940de9042e2c036cfb855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:17:10.228483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:10.229421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:10.239930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1108/2222] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:17:10 2021] DELETE /identity/v3/projects/88a6d9c2f5a940de9042e2c036cfb855 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:10.249097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:10.251584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:10.337065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3defd2-ea80-4d02-bc8c-08b20759edc3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:10.409426 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:10.410089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:10.410375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:10.410653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:10.412885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:10.473521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:10.475164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5b30-f996-4ea3-b151-f64a4a73d555 service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:10.483452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1115/2223] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:17:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:17:13.980422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:13.982646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:14.045979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daebc5-84b9-4c5c-82c6-fe096203cfe2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:14.051120 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:14.051969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.052251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.052531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] PATH_INFO: `/v3/users/e353240b64ff4209b20f7607410f6f7b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.053724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e353240b64ff4209b20f7607410f6f7b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:14.055665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:14.100527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e353240b64ff4209b20f7607410f6f7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.106951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e353240b64ff4209b20f7607410f6f7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.107619 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e353240b64ff4209b20f7607410f6f7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.119348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e353240b64ff4209b20f7607410f6f7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.126636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e353240b64ff4209b20f7607410f6f7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.133027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1109/2224] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:17:13 2021] DELETE /identity/v3/users/e353240b64ff4209b20f7607410f6f7b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:14.137663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.138146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.138288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.156090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:14.157276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:14.225040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1116/2225] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:14.235686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:14.237651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:14.297130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2137d26-e005-491a-9c40-97a6be12dad0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:14.301399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2631-e109-40e5-b4d4-3dd9d2b9d13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:14.302022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2631-e109-40e5-b4d4-3dd9d2b9d13c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.302301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2631-e109-40e5-b4d4-3dd9d2b9d13c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.302573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2631-e109-40e5-b4d4-3dd9d2b9d13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.311236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2631-e109-40e5-b4d4-3dd9d2b9d13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:14.312644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2631-e109-40e5-b4d4-3dd9d2b9d13c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:14.321715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1110/2226] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:14.592765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:14.594184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:14.608431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e329-1ce7-4981-bb9c-b12c73c89e0c None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:14.613359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:14.614749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.615218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.615502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] PATH_INFO: `/v3/projects/8f0f7e74982140f2a2047ce729262110` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.616731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0f7e74982140f2a2047ce729262110)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:14.618548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:14.664501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0f7e74982140f2a2047ce729262110', 'request_id': 'req-b5891131-4490-4b5d-83b8-ac0d711fd6d8'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.670847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0f7e74982140f2a2047ce729262110', 'request_id': 'req-b5891131-4490-4b5d-83b8-ac0d711fd6d8'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.678829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0f7e74982140f2a2047ce729262110', 'request_id': 'req-b5891131-4490-4b5d-83b8-ac0d711fd6d8'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.689164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] The token cache is being invalidate because project 8f0f7e74982140f2a2047ce729262110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:17:14.689443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.690076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b5891131-4490-4b5d-83b8-ac0d711fd6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:14.691695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1117/2227] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:17:14 2021] DELETE /identity/v3/projects/8f0f7e74982140f2a2047ce729262110 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:14.697244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.697537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.697817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.715522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:14.716724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:14.788218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1111/2228] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:14.796843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.797130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.797405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.816555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:14.817722 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:14.825961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1118/2229] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:14.830127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:14.840112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8b29c-7a1e-471d-bb13-d5318afbc47f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:14.844716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:14.845349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.845628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.845902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.847242 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:17:14.847548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:14.849127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:14.860741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1112/2230] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:17:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:17:14.865438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:14.874823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95202c3f-cea3-4815-a141-d43d1913456a None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:14.879677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:14.880330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.880623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.880930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.881599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:14.883571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:14.909412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1119/2231] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:17:14 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:17:14.913372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:14.922982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733268-e2a3-4fd9-87eb-cac3418a5cd0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:14.978202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:14.978852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:14.979162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:14.979433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:14.980130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:14.982011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:15.003722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1113/2232] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:17:14 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:17:15.008032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:15.019449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186c59-33a8-4b94-8ebe-0d63fee9a1ec admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:15.024412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:15.025025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:15.025459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:15.025738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:15.026482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:15.028117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:15.039433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1120/2233] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:17:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:17:15.043496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:15.054205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2010f1-7e10-4097-b2e0-f9afac760695 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:15.058912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5663-b77f-4e6d-b1b3-004ad6424b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:15.059602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5663-b77f-4e6d-b1b3-004ad6424b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:15.059881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5663-b77f-4e6d-b1b3-004ad6424b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:15.060154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5663-b77f-4e6d-b1b3-004ad6424b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:15.060886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5663-b77f-4e6d-b1b3-004ad6424b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:15.062494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5663-b77f-4e6d-b1b3-004ad6424b34 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:15.073318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1114/2234] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:17:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:17:15.077700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:15.088401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e433-1908-4472-a89b-4dfe9417ba65 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:15.092944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:15.093804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:15.094103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:15.094372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] PATH_INFO: `/v3/projects/7a48a5d61c7344a9ae7f8d387cf5da5e/users/4a44379ab3374d45a69d7d95726b630f/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:15.108326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a48a5d61c7344a9ae7f8d387cf5da5e, user_id=4a44379ab3374d45a69d7d95726b630f, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:15.110958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:15.123768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1121/2235] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:17:15 2021] PUT /identity/v3/projects/7a48a5d61c7344a9ae7f8d387cf5da5e/users/4a44379ab3374d45a69d7d95726b630f/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:17:15.134459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:15.134749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:15.135024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:15.161079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] MFA Rules not processed for user `4a44379ab3374d45a69d7d95726b630f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:15.162315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:15.222927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1115/2236] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:15 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:15.233080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:15.234891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:15.303963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7f9cd-150a-46e4-8ac1-66c85af28f86 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:15.310363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5385b-8512-45b5-a547-50b0320efb37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:15.311079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5385b-8512-45b5-a547-50b0320efb37 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:15.311330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5385b-8512-45b5-a547-50b0320efb37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:15.311600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5385b-8512-45b5-a547-50b0320efb37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:15.321735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5385b-8512-45b5-a547-50b0320efb37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:15.323194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5385b-8512-45b5-a547-50b0320efb37 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:15.332384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1122/2237] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:15 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:18.899909 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:18.960422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f619a-8199-4a47-8776-37f63556c3c8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:18.965105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:18.965951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:18.966235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:18.966508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] PATH_INFO: `/v3/users/4a44379ab3374d45a69d7d95726b630f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:18.967727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a44379ab3374d45a69d7d95726b630f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:18.970404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.028901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a44379ab3374d45a69d7d95726b630f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.036792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a44379ab3374d45a69d7d95726b630f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.037665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a44379ab3374d45a69d7d95726b630f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.050622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a44379ab3374d45a69d7d95726b630f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.058365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a44379ab3374d45a69d7d95726b630f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.064801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1116/2238] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:17:18 2021] DELETE /identity/v3/users/4a44379ab3374d45a69d7d95726b630f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:19.070269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.070787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.070908 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.088098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:19.089272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:19.146188 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1123/2239] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:17:19.155843 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.157220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:19.218137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdd8d2-5fec-4fea-80e1-161ae67c2bb4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:19.222281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0af96-66e3-4034-b06a-fef7b77099d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:19.224674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0af96-66e3-4034-b06a-fef7b77099d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.224674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0af96-66e3-4034-b06a-fef7b77099d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.224674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0af96-66e3-4034-b06a-fef7b77099d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.234419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0af96-66e3-4034-b06a-fef7b77099d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:19.236070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0af96-66e3-4034-b06a-fef7b77099d9 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.246660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1117/2240] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:19.519010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.520653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:19.537187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c63b2b-3df3-4b89-ac22-ecbd9b630d35 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:19.542528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:19.543850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.544292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.544584 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] PATH_INFO: `/v3/projects/7a48a5d61c7344a9ae7f8d387cf5da5e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.545992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a48a5d61c7344a9ae7f8d387cf5da5e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:19.547987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.596890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a48a5d61c7344a9ae7f8d387cf5da5e', 'request_id': 'req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.603280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a48a5d61c7344a9ae7f8d387cf5da5e', 'request_id': 'req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.610563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a48a5d61c7344a9ae7f8d387cf5da5e', 'request_id': 'req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.621960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] The token cache is being invalidate because project 7a48a5d61c7344a9ae7f8d387cf5da5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:17:19.622403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.623194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-0e75116e-4609-47a5-a1d8-4c3a0a65a7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:19.630154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1124/2241] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:17:19 2021] DELETE /identity/v3/projects/7a48a5d61c7344a9ae7f8d387cf5da5e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:19.631367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.631667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.631937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.653285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:19.654520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:19.726375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1118/2242] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:19.733886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.734177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.734459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.753415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:19.754611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:19.762395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1125/2243] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:19.766463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.776649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a9534-ce38-45c0-b092-f09ab691a934 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:19.781155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:19.781790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.782069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.782334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.783128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:17:19.783477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:19.785079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.805533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1119/2244] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:17:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:17:19.809795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.819790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5396b-6799-453d-860f-bd41da608087 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:19.824608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:19.825257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.825534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.825805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.826531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:19.828462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.856558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1126/2245] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:17:19 2021] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:17:19.860723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.871456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494d9ed-887e-487f-8762-254d313e6d14 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:19.924007 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:19.925238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.925445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.925718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.926418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:19.928337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.948337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1120/2246] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:17:19 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:17:19.952362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.962410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405093-2270-488f-b9d2-c8c85d7e71f8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:19.966973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:19.967746 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:19.968032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:19.968305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:19.969072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:19.971020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:19.981133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1127/2247] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:17:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:17:19.984927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:19.995345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233058-c13b-4911-b9fc-e13d394e60ec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:20.000032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7279d-2e3a-4d9b-ae86-932e5beea9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:20.000678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7279d-2e3a-4d9b-ae86-932e5beea9db admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:20.000963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7279d-2e3a-4d9b-ae86-932e5beea9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:20.001238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7279d-2e3a-4d9b-ae86-932e5beea9db admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:20.001965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7279d-2e3a-4d9b-ae86-932e5beea9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:20.004247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7279d-2e3a-4d9b-ae86-932e5beea9db admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:20.013912 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1121/2248] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:17:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:17:20.017892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:20.028766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612374-ada7-40d8-835b-b27520edd1e2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:20.034761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:20.035946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:20.036349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:20.036718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] PATH_INFO: `/v3/projects/7057ece3359645f0878e2bd79bf045ec/users/7135fe1dd7db40328fa4ea296ea9825d/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:20.053886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7057ece3359645f0878e2bd79bf045ec, user_id=7135fe1dd7db40328fa4ea296ea9825d, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:20.056532 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:20.074387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1128/2249] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:17:20 2021] PUT /identity/v3/projects/7057ece3359645f0878e2bd79bf045ec/users/7135fe1dd7db40328fa4ea296ea9825d/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:17:20.085634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:20.085937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:20.086191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:20.128195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] MFA Rules not processed for user `7135fe1dd7db40328fa4ea296ea9825d`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:20.129421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:20.192809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1122/2250] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:20 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:20.203471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:20.205099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:20.268959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f7df5-26b0-4bd2-872a-39ff27fa766f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:20.273180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab0f6-01b0-405e-bd07-389e0dbf3b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:20.274057 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab0f6-01b0-405e-bd07-389e0dbf3b99 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:20.274419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab0f6-01b0-405e-bd07-389e0dbf3b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:20.274755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab0f6-01b0-405e-bd07-389e0dbf3b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:20.284967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab0f6-01b0-405e-bd07-389e0dbf3b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:20.286435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab0f6-01b0-405e-bd07-389e0dbf3b99 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:20.295119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1129/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:20 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:37.572434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:37.690279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe81d9-fd89-4b7e-accf-db0fa769f045 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:37.695317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:37.696169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:37.696449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:37.696719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] PATH_INFO: `/v3/users/7135fe1dd7db40328fa4ea296ea9825d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:37.697931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7135fe1dd7db40328fa4ea296ea9825d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:37.699862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:37.745582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7135fe1dd7db40328fa4ea296ea9825d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:37.752200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7135fe1dd7db40328fa4ea296ea9825d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:37.752950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7135fe1dd7db40328fa4ea296ea9825d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:37.764189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7135fe1dd7db40328fa4ea296ea9825d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:37.772410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7135fe1dd7db40328fa4ea296ea9825d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:37.778433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1123/2252] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:17:37 2021] DELETE /identity/v3/users/7135fe1dd7db40328fa4ea296ea9825d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:37.782949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:37.783509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:37.784249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:37.831306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:37.832485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:37.886990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1130/2253] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:37.897355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:37.898755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:37.991110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1a90-4751-459e-b20f-d4e3cf950393 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:37.994751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:37.995415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:37.995700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:37.995974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:38.005803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:38.007315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:38.017375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1124/2254] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:38.298347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:38.300370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:38.311941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e0b3b-6ea4-4c6e-9ac2-94759632d77d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:38.317353 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:38.318202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:38.318477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:38.318750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] PATH_INFO: `/v3/projects/7057ece3359645f0878e2bd79bf045ec` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:38.320004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7057ece3359645f0878e2bd79bf045ec)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:38.322371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:38.370161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7057ece3359645f0878e2bd79bf045ec', 'request_id': 'req-71ceac5a-3b29-4827-9212-1c974b1307e9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:38.376552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7057ece3359645f0878e2bd79bf045ec', 'request_id': 'req-71ceac5a-3b29-4827-9212-1c974b1307e9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:38.383900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7057ece3359645f0878e2bd79bf045ec', 'request_id': 'req-71ceac5a-3b29-4827-9212-1c974b1307e9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:38.394295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] The token cache is being invalidate because project 7057ece3359645f0878e2bd79bf045ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:17:38.394576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:38.395237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-71ceac5a-3b29-4827-9212-1c974b1307e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:38.396902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1131/2255] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:17:38 2021] DELETE /identity/v3/projects/7057ece3359645f0878e2bd79bf045ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:40.227606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:40.229054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:40.241594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3aa56-bc55-4a4e-8f08-453b4166fbd9 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:40.301448 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:40.302291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:40.302568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:40.302836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] PATH_INFO: `/v3/users/ba0d1dd228ee455797bd1821a94380fd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:40.304045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0d1dd228ee455797bd1821a94380fd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:40.305936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:40.348584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0d1dd228ee455797bd1821a94380fd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.356003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0d1dd228ee455797bd1821a94380fd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.356662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0d1dd228ee455797bd1821a94380fd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.369538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0d1dd228ee455797bd1821a94380fd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.376779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0d1dd228ee455797bd1821a94380fd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.383701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1125/2256] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:17:40 2021] DELETE /identity/v3/users/ba0d1dd228ee455797bd1821a94380fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:40.388251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:40.388699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:40.388822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:40.405960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:40.407202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:40.464794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1132/2257] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:40.474454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:40.475957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:40.531221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fd61-ce2d-4708-93b9-79bba17496aa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:40.534933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9f994-1058-4b27-a1af-9f10ebe6f91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:40.535598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9f994-1058-4b27-a1af-9f10ebe6f91b service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:40.535878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9f994-1058-4b27-a1af-9f10ebe6f91b service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:40.536152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9f994-1058-4b27-a1af-9f10ebe6f91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:40.544910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9f994-1058-4b27-a1af-9f10ebe6f91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:40.546321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9f994-1058-4b27-a1af-9f10ebe6f91b service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:40.555541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1126/2258] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:17:40.810659 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:40.812095 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:40.825610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1850865-a090-43e5-994e-490ca8fbe554 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:40.830567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:40.831395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:40.831671 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:40.831940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] PATH_INFO: `/v3/projects/ee285a93d443472aa894db88321f757e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:40.833918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee285a93d443472aa894db88321f757e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:40.836006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:40.883876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee285a93d443472aa894db88321f757e', 'request_id': 'req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.889759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee285a93d443472aa894db88321f757e', 'request_id': 'req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.897473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee285a93d443472aa894db88321f757e', 'request_id': 'req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.907710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] The token cache is being invalidate because project ee285a93d443472aa894db88321f757e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:17:40.907997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.909198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1c185f1e-1800-4d4e-8d99-cc3eca6675a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:17:40.910737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1133/2259] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:17:40 2021] DELETE /identity/v3/projects/ee285a93d443472aa894db88321f757e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:17:40.916779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:40.917092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:40.917360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:40.954583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:40.956424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:41.013513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1127/2260] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:41.021571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.021861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.022138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.040677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:41.041880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:41.051288 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1134/2261] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:41.055701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.066022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c30ff9-c974-467b-8ac4-13222b58b2cb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.071170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.071826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.072108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.072380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.073118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:17:41.073423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.075015 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.098573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1128/2262] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:17:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:17:41.100101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.112010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff937-f87d-4e9b-a64b-38dc146f8396 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.123258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.124261 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.124612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.124887 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.125585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.128145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.166037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1135/2263] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:17:41 2021] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:17:41.169839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.181214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39353bd3-2d7f-4d5a-b603-d86bdf1277b7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.251954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.253924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.254541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.254963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.256454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.259177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.285792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1129/2264] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:17:41 2021] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:17:41.290134 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.304641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178ce9-52ca-4b93-a0fb-ccbd91d48236 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.310199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.310863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.311172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.311444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.312187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.313974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.327029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1136/2265] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:17:41 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:17:41.331275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.349701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc488bd-fee8-48ec-9fe3-489cbbde8597 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.357862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f09a7-ae4a-4b2e-b7ff-72ae6716641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.360617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f09a7-ae4a-4b2e-b7ff-72ae6716641e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.361977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f09a7-ae4a-4b2e-b7ff-72ae6716641e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.361977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f09a7-ae4a-4b2e-b7ff-72ae6716641e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.362489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f09a7-ae4a-4b2e-b7ff-72ae6716641e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.371730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f09a7-ae4a-4b2e-b7ff-72ae6716641e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.395607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1130/2266] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:17:41 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:17:41.397892 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.412304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e38b0-6769-4431-bded-8f37aef61f5f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.418539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.419753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.420691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.421058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] PATH_INFO: `/v3/projects/011632315e3446548bfe43987fb7de9e/users/a896147db55f4ca08fa2c128d1a1ef83/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.442422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=011632315e3446548bfe43987fb7de9e, user_id=a896147db55f4ca08fa2c128d1a1ef83, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.445174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.470080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1137/2267] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:17:41 2021] PUT /identity/v3/projects/011632315e3446548bfe43987fb7de9e/users/a896147db55f4ca08fa2c128d1a1ef83/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:17:41.480191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055db15-ec41-4b9f-84d5-37c7822c40d9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.480512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055db15-ec41-4b9f-84d5-37c7822c40d9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.480785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055db15-ec41-4b9f-84d5-37c7822c40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.513217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5055db15-ec41-4b9f-84d5-37c7822c40d9 None None] MFA Rules not processed for user `a896147db55f4ca08fa2c128d1a1ef83`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:17:41.514451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5055db15-ec41-4b9f-84d5-37c7822c40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:41.585635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1131/2268] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:17:41.596036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:17:41.597758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:17:41.679270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464f21-120d-4718-989d-ce232e2e25dd admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:17:41.685762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8543a5-04e4-41fc-8a4a-483b257377de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:17:41.686603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8543a5-04e4-41fc-8a4a-483b257377de service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:17:41.686893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8543a5-04e4-41fc-8a4a-483b257377de service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:17:41.687202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8543a5-04e4-41fc-8a4a-483b257377de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:17:41.699138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8543a5-04e4-41fc-8a4a-483b257377de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:17:41.700865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8543a5-04e4-41fc-8a4a-483b257377de service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:17:41.712156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1138/2269] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:17:41 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:18:01.739550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646740fd-d8e4-4d7c-a7e7-059aad1d0335 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:01.740071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646740fd-d8e4-4d7c-a7e7-059aad1d0335 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:01.740183 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646740fd-d8e4-4d7c-a7e7-059aad1d0335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:01.763496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-646740fd-d8e4-4d7c-a7e7-059aad1d0335 None None] MFA Rules not processed for user `0a133cb1175e4130902bbcdeaedd74f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:01.764715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-646740fd-d8e4-4d7c-a7e7-059aad1d0335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:01.820874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1132/2270] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:01 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:02.861142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d63683-1838-441c-86a5-f2c724cf0933 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:02.861607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d63683-1838-441c-86a5-f2c724cf0933 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:02.861716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d63683-1838-441c-86a5-f2c724cf0933 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:02.863783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1139/2271] 10.222.0.43 () {54 vars in 960 bytes} [Tue Dec 14 03:18:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:18:02.868963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:02.869377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:02.869515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:02.936902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] MFA Rules not processed for user `8ae3d39ccc094e7db89711d3f52701f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:02.938931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:03.007848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1133/2272] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Dec 14 03:18:02 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:03.015526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d63683-1838-441c-86a5-f2c724cf0933 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:03.029307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d63683-1838-441c-86a5-f2c724cf0933 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:03.034260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:03.034883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:03.035206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:03.035483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:03.037232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:03.048630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:03.050214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ba8e3-b2db-4fff-b4e6-e4c94851bb79 service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:03.059750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1140/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:18:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:18:09.219927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:09.221575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:09.284365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9285c-4aa1-47ac-8831-ec7a0ff69753 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:09.288453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:09.289100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:09.289385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:09.289662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:09.291518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:09.359858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:09.361936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:09.372653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1134/2274] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:18:09 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:18:32.168639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09e587-b343-403e-94ba-31d616e9e098 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:32.169191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09e587-b343-403e-94ba-31d616e9e098 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:32.169191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09e587-b343-403e-94ba-31d616e9e098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:32.186739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6c09e587-b343-403e-94ba-31d616e9e098 None None] MFA Rules not processed for user `0a133cb1175e4130902bbcdeaedd74f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:32.187954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6c09e587-b343-403e-94ba-31d616e9e098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:32.194590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1141/2275] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:32 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:18:37.614111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:37.672473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594609c7-7fa3-49c5-b978-1d7558ce2d6c service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:37.677137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:37.677975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:37.678255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:37.678528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] PATH_INFO: `/v3/users/a896147db55f4ca08fa2c128d1a1ef83` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:37.679748 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a896147db55f4ca08fa2c128d1a1ef83)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:37.681640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:37.725578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a896147db55f4ca08fa2c128d1a1ef83'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:37.732116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a896147db55f4ca08fa2c128d1a1ef83'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:37.732762 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a896147db55f4ca08fa2c128d1a1ef83'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:37.744525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a896147db55f4ca08fa2c128d1a1ef83'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:37.751338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a896147db55f4ca08fa2c128d1a1ef83'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:37.757688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1135/2276] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:18:37 2021] DELETE /identity/v3/users/a896147db55f4ca08fa2c128d1a1ef83 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:18:37.762282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:37.762731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:37.762850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:37.779796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:37.781001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:37.838255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1142/2277] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:37.848280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:37.849838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:37.908749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81e4c1-ef25-4767-ab0a-5f894daf4520 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:37.913110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:37.913799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:37.914081 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:37.914370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:37.923451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:37.924894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:37.934428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1136/2278] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:18:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:18:38.292090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:38.293660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:38.305255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a0b3-94bc-4f61-8276-6e21562d329b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:38.309827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:38.310666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:38.310941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:38.311238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] PATH_INFO: `/v3/projects/011632315e3446548bfe43987fb7de9e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:38.312481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=011632315e3446548bfe43987fb7de9e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:38.314351 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:38.360958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011632315e3446548bfe43987fb7de9e', 'request_id': 'req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:38.366942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011632315e3446548bfe43987fb7de9e', 'request_id': 'req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:38.375230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011632315e3446548bfe43987fb7de9e', 'request_id': 'req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:38.395323 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] The token cache is being invalidate because project 011632315e3446548bfe43987fb7de9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:18:38.395608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:38.396819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:38.398617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1143/2279] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:18:38 2021] DELETE /identity/v3/projects/011632315e3446548bfe43987fb7de9e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:18:55.752563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:55.754556 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:55.767260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e92a5-26f0-406d-bbfb-628a31a2978e service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:55.824133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:55.825078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:55.825368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:55.825817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] PATH_INFO: `/v3/users/57a541b5dc154896bced57a79750a3c4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:55.827226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a541b5dc154896bced57a79750a3c4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:55.829201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:55.878229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a541b5dc154896bced57a79750a3c4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:55.885361 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a541b5dc154896bced57a79750a3c4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:55.886044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a541b5dc154896bced57a79750a3c4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:55.897324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a541b5dc154896bced57a79750a3c4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:55.904201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c46a3231-9782-41ad-a7da-1197c76ac9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a541b5dc154896bced57a79750a3c4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:55.910118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1137/2280] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:18:55 2021] DELETE /identity/v3/users/57a541b5dc154896bced57a79750a3c4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:18:56.091688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.094456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:56.110438 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2da07-12a6-4b94-bcdf-91297e8fee7c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.169133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.169978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.170256 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.170526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] PATH_INFO: `/v3/projects/bb4be946dd9b4b2080fb3b398521624e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.171728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4be946dd9b4b2080fb3b398521624e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.173619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.218056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4be946dd9b4b2080fb3b398521624e', 'request_id': 'req-9aaac63d-88be-42a2-9d23-100b6088ad6d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:56.224515 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4be946dd9b4b2080fb3b398521624e', 'request_id': 'req-9aaac63d-88be-42a2-9d23-100b6088ad6d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:56.231850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4be946dd9b4b2080fb3b398521624e', 'request_id': 'req-9aaac63d-88be-42a2-9d23-100b6088ad6d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:56.242692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] The token cache is being invalidate because project bb4be946dd9b4b2080fb3b398521624e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:18:56.242967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:56.243633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9aaac63d-88be-42a2-9d23-100b6088ad6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:18:56.245453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1144/2281] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:18:56 2021] DELETE /identity/v3/projects/bb4be946dd9b4b2080fb3b398521624e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:18:56.251064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.251446 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.251669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.271106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:56.272305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:56.330613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1138/2282] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:56.338635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.339023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.339337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.358707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:56.359956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:56.368798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1145/2283] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:56.373014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.382957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fdb1-b6b3-4deb-95f6-96da100f4255 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.387975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.388614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.388893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.389164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.389887 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:18:56.390187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.391798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.403335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1139/2284] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:18:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:18:56.407937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.418877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20af27-355a-40e6-a288-6f7f858b7527 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.424241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.424894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.425222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.425578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.426289 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.428226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.454061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1146/2285] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:18:56.458757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.468848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384c164-e510-440b-b1f0-d9d422148150 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.524774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.525430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.525708 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.525978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.526684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.528624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.547941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1140/2286] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:18:56.552055 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.561914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc563d4-5aad-478a-bb35-627195ac5397 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.566433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.567093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.567375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.567647 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.568365 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.569959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.580126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1147/2287] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:18:56.584613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.594052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a81e-e061-46c0-8b6b-a239fc4ec8f4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.599346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f09d5b-a7f1-490e-b08c-dfd5a3ed3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.599961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f09d5b-a7f1-490e-b08c-dfd5a3ed3d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.600240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f09d5b-a7f1-490e-b08c-dfd5a3ed3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.600509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f09d5b-a7f1-490e-b08c-dfd5a3ed3d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.601237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f09d5b-a7f1-490e-b08c-dfd5a3ed3d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.602787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f09d5b-a7f1-490e-b08c-dfd5a3ed3d0d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.612269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1141/2288] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:18:56.616368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.625807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c518164-746b-43d7-b17e-8b7e69bb6a88 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.635691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.636569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.636847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.637117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] PATH_INFO: `/v3/projects/440ec90268da41da8dbb69474818976d/users/d0204aa2be2b4602b3667185cb76d5a4/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.651959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440ec90268da41da8dbb69474818976d, user_id=d0204aa2be2b4602b3667185cb76d5a4, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.654601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.668574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1148/2289] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:18:56 2021] PUT /identity/v3/projects/440ec90268da41da8dbb69474818976d/users/d0204aa2be2b4602b3667185cb76d5a4/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:18:56.678174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.678532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.678885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.704027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] MFA Rules not processed for user `d0204aa2be2b4602b3667185cb76d5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:56.705214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:56.765540 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1142/2290] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:56.770342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.829511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bedd95-a3c3-4379-ba58-47ebd504dcd8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.835435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.836109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.836388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.836658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.837362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.839277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.866954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1149/2291] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:18:56.870990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.882004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a69bc3-25ec-4697-89a4-8f97f9860af7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.935719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.936370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.936652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.936926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.937606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.939504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.959766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1143/2292] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:18:56 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:18:56.963809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:56.974027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69dde1-5fe8-4613-ac05-126e6906ad76 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:56.978629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:56.979307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:56.979590 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:56.979866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:56.980596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:56.982382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:56.992951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1150/2293] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:18:56.996839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:57.006949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990dd07-f19d-4406-8b4e-b1a27ddbcd70 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:57.011680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:57.012538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:57.012820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:57.013096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] PATH_INFO: `/v3/projects/1a1de7e955aa4197bab1ac8cc3e28ba9/users/0fae56138fad43ff9b34e6ece7a69a26/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:57.027712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1de7e955aa4197bab1ac8cc3e28ba9, user_id=0fae56138fad43ff9b34e6ece7a69a26, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:57.030326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:57.042817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1144/2294] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:18:56 2021] PUT /identity/v3/projects/1a1de7e955aa4197bab1ac8cc3e28ba9/users/0fae56138fad43ff9b34e6ece7a69a26/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:18:57.046662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:57.056495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041acd-7ca5-4e48-a764-23d4435bd8f2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:57.111211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b9648-d5b3-440b-acdf-556a5e7dfef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:57.111870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9648-d5b3-440b-acdf-556a5e7dfef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:57.112150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9648-d5b3-440b-acdf-556a5e7dfef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:57.112423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9648-d5b3-440b-acdf-556a5e7dfef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:57.113779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9648-d5b3-440b-acdf-556a5e7dfef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:57.115412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9648-d5b3-440b-acdf-556a5e7dfef1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:57.125115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1151/2295] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:18:57 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:18:57.129789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:57.139714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e59647-d6ef-4f5d-be20-2d344ca81e14 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:57.144849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:57.145695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:57.146002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:57.146302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] PATH_INFO: `/v3/projects/1a1de7e955aa4197bab1ac8cc3e28ba9/users/0fae56138fad43ff9b34e6ece7a69a26/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:57.148402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1de7e955aa4197bab1ac8cc3e28ba9, user_id=0fae56138fad43ff9b34e6ece7a69a26, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:57.150994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:57.160950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1145/2296] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:18:57 2021] PUT /identity/v3/projects/1a1de7e955aa4197bab1ac8cc3e28ba9/users/0fae56138fad43ff9b34e6ece7a69a26/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:18:57.170662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:57.170952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:57.171260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:57.197678 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] MFA Rules not processed for user `0fae56138fad43ff9b34e6ece7a69a26`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:57.198863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:57.263313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1152/2297] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:18:57 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:57.273346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:57.275142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:57.350738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4acd9-9c82-4d1d-99a1-b95abd4e6977 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:57.355112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817841-3a31-4d62-80f4-b50a5be0110c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:57.355879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817841-3a31-4d62-80f4-b50a5be0110c service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:57.356232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817841-3a31-4d62-80f4-b50a5be0110c service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:57.356542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817841-3a31-4d62-80f4-b50a5be0110c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:57.368558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d817841-3a31-4d62-80f4-b50a5be0110c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:57.370661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d817841-3a31-4d62-80f4-b50a5be0110c service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:57.384374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1146/2298] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:18:57 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:18:57.452407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:57.461967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201ae2-89dd-4a82-be35-16b129ee0b43 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:57.465544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:57.466167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:57.466443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:57.466710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:57.524102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:57.525440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:57.534958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1153/2299] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:18:57 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:18:58.865408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:58.865929 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:58.866034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:58.917484 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:18:58.918650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:58.987676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1147/2300] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:18:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:18:59.029657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:18:59.031119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:18:59.133819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a318-d879-4e88-876f-d9c9e3e47db5 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:18:59.140781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabdc08-2e37-4f0a-acdc-79027e3393cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:18:59.140781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabdc08-2e37-4f0a-acdc-79027e3393cf service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:18:59.140781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabdc08-2e37-4f0a-acdc-79027e3393cf service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:18:59.140781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabdc08-2e37-4f0a-acdc-79027e3393cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:18:59.151688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabdc08-2e37-4f0a-acdc-79027e3393cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:18:59.153538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabdc08-2e37-4f0a-acdc-79027e3393cf service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:18:59.163293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1154/2301] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:18:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:19:00.260227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:00.352642 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4dd6-17cc-473f-8a27-868f2712eeef None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:00.359091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:00.359974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:00.360278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:00.360536 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] PATH_INFO: `/v3/users/d0204aa2be2b4602b3667185cb76d5a4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:00.361927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0204aa2be2b4602b3667185cb76d5a4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:00.364393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:00.422347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0204aa2be2b4602b3667185cb76d5a4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:00.429989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0204aa2be2b4602b3667185cb76d5a4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:00.430736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0204aa2be2b4602b3667185cb76d5a4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:00.443581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0204aa2be2b4602b3667185cb76d5a4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:00.452538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0204aa2be2b4602b3667185cb76d5a4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:00.459449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1148/2302] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:19:00 2021] DELETE /identity/v3/users/d0204aa2be2b4602b3667185cb76d5a4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:00.464631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:00.465124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:00.465217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:00.488422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:00.490033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:00.564350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1155/2303] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:00.572126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:00.573758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:00.645411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9acdb6-9efa-4eaa-b3a5-39a4b2eca7b5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:00.649738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:00.650607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:00.651090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:00.651538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:00.665092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:00.666851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:00.696202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1149/2304] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:01.091271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:01.092968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:01.122787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3daa-5872-4b4e-89af-02a3a8abc9cf None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:01.141533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:01.147489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:01.148530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:01.149360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] PATH_INFO: `/v3/projects/440ec90268da41da8dbb69474818976d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:01.151956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440ec90268da41da8dbb69474818976d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:01.155374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:01.225522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440ec90268da41da8dbb69474818976d', 'request_id': 'req-7a3dd245-6aec-4818-8390-49019704e401'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.238602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440ec90268da41da8dbb69474818976d', 'request_id': 'req-7a3dd245-6aec-4818-8390-49019704e401'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.258153 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440ec90268da41da8dbb69474818976d', 'request_id': 'req-7a3dd245-6aec-4818-8390-49019704e401'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.291629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] The token cache is being invalidate because project 440ec90268da41da8dbb69474818976d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:19:01.291629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.292655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.296355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1156/2305] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:19:01 2021] DELETE /identity/v3/projects/440ec90268da41da8dbb69474818976d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:01.299802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:01.326383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693e91c-602f-449f-a929-0c73f169e909 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:01.484165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:01.485470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:01.485800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:01.486016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] PATH_INFO: `/v3/users/0fae56138fad43ff9b34e6ece7a69a26` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:01.488291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fae56138fad43ff9b34e6ece7a69a26)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:01.490217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:01.547518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fae56138fad43ff9b34e6ece7a69a26'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.555934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fae56138fad43ff9b34e6ece7a69a26'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.556688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fae56138fad43ff9b34e6ece7a69a26'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.573437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fae56138fad43ff9b34e6ece7a69a26'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.584299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-18a1e457-606f-4fe7-9a5e-b693bbb742b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fae56138fad43ff9b34e6ece7a69a26'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:01.591345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1150/2306] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:19:01 2021] DELETE /identity/v3/users/0fae56138fad43ff9b34e6ece7a69a26 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:01.920489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:01.922929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:01.948534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dd245-6aec-4818-8390-49019704e401 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.046381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.048362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.049031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.049309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] PATH_INFO: `/v3/projects/1a1de7e955aa4197bab1ac8cc3e28ba9` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.052475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1de7e955aa4197bab1ac8cc3e28ba9)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.054127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.139356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1de7e955aa4197bab1ac8cc3e28ba9', 'request_id': 'req-cccd24d7-f832-4570-956b-3d41d6077141'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:02.150963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1de7e955aa4197bab1ac8cc3e28ba9', 'request_id': 'req-cccd24d7-f832-4570-956b-3d41d6077141'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:02.171429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1de7e955aa4197bab1ac8cc3e28ba9', 'request_id': 'req-cccd24d7-f832-4570-956b-3d41d6077141'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:02.184420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] The token cache is being invalidate because project 1a1de7e955aa4197bab1ac8cc3e28ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:19:02.184699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:02.185687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cccd24d7-f832-4570-956b-3d41d6077141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:02.195290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1157/2307] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:19:01 2021] DELETE /identity/v3/projects/1a1de7e955aa4197bab1ac8cc3e28ba9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:02.201008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.202836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.203149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.242252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:02.243408 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:02.351702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1151/2308] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:19:02.356913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.356913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.356913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.383701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:02.384977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:02.397484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1158/2309] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:19:02.400544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.412931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7bb0d-3587-4dd9-9e57-2291f8c8b05c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.418101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.418936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.419410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.419832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.421677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:19:02.422154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.423938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.442813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1152/2310] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:19:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:19:02.446627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.461881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b1089-a8f1-4c7f-b671-0e04e2ece080 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.468362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.469582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.469886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.470259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.470866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.473909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.513819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1159/2311] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:19:02 2021] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:02.517600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.535355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ece80-f682-40c6-8a8b-cef1f49439c5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.605373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.606061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.606338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.606606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.607352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.609493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.636059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1153/2312] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:19:02 2021] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:02.637243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.652652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b39433-1957-41dd-a4a2-369959746370 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.664989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.665927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.666409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.666889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.667674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.670086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.686033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1160/2313] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:02 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:02.687825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.698386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2862-c381-49e0-a8d9-44c5a17cd506 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.703248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84babfc1-931f-45c9-81c9-8436e0bb3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.703915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84babfc1-931f-45c9-81c9-8436e0bb3c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.704200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84babfc1-931f-45c9-81c9-8436e0bb3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.704523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84babfc1-931f-45c9-81c9-8436e0bb3c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.705221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84babfc1-931f-45c9-81c9-8436e0bb3c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.707756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84babfc1-931f-45c9-81c9-8436e0bb3c1f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.720951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1154/2314] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:02.725472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.737112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe3738-3ee6-4269-88f6-719ed40cbc31 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.745316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.746257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.746560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.746847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] PATH_INFO: `/v3/projects/f937350c93bc4d4290e99e19c2ea2d70/users/a8865953a5ea440b864fd3f55c9b5f2f/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.763068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f937350c93bc4d4290e99e19c2ea2d70, user_id=a8865953a5ea440b864fd3f55c9b5f2f, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.765926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:02.782087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1161/2315] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:19:02 2021] PUT /identity/v3/projects/f937350c93bc4d4290e99e19c2ea2d70/users/a8865953a5ea440b864fd3f55c9b5f2f/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:19:02.793525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.793817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.794099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.823818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] MFA Rules not processed for user `a8865953a5ea440b864fd3f55c9b5f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:02.825056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:02.893108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1155/2316] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:19:02.898306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:02.962454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d8f18-3eb7-457f-bd0c-c641f88f6b10 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:02.967886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:02.968540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:02.968816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:02.969093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:02.969808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:02.972023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.014593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1162/2317] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:19:02 2021] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:03.015520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:03.027182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9dbee-5dca-4071-bbd3-7ba25e21a3a3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:03.089417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:03.090102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.090383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.090665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.091421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:03.093461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.117365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1156/2318] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:19:03 2021] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:19:03.121273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:03.132548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0342-fd58-4d48-bbc1-11d56ff02f54 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:03.137972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:03.138754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.139133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.139482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.140223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:03.141828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.156942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1163/2319] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:03.158578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:03.168730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cd27d-f717-4248-9c6f-dc8e0043da69 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:03.173645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:03.174535 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.175376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.175658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] PATH_INFO: `/v3/projects/fa764459cc0b4544bd81a9fb59608133/users/5a3a83e3a19846fd8ddd60ae0f9f4fc2/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.191577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa764459cc0b4544bd81a9fb59608133, user_id=5a3a83e3a19846fd8ddd60ae0f9f4fc2, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:03.194222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.209512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1157/2320] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:19:03 2021] PUT /identity/v3/projects/fa764459cc0b4544bd81a9fb59608133/users/5a3a83e3a19846fd8ddd60ae0f9f4fc2/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:03.213514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:03.224208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483749e0-a03b-4fcc-8f3b-280381373eac admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:03.289111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6f4e0-b884-439e-bba4-f9593ce483be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:03.289719 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f4e0-b884-439e-bba4-f9593ce483be admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.290001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f4e0-b884-439e-bba4-f9593ce483be admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.290275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f4e0-b884-439e-bba4-f9593ce483be admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.291018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f4e0-b884-439e-bba4-f9593ce483be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:03.292645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f4e0-b884-439e-bba4-f9593ce483be admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.307114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1164/2321] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:03.308557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:03.319814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188610e-ee50-4778-b9b3-8df25f03e1cd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:03.324768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:03.325649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.325930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.326207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] PATH_INFO: `/v3/projects/fa764459cc0b4544bd81a9fb59608133/users/5a3a83e3a19846fd8ddd60ae0f9f4fc2/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.328234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa764459cc0b4544bd81a9fb59608133, user_id=5a3a83e3a19846fd8ddd60ae0f9f4fc2, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:03.330861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.341675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1158/2322] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:19:03 2021] PUT /identity/v3/projects/fa764459cc0b4544bd81a9fb59608133/users/5a3a83e3a19846fd8ddd60ae0f9f4fc2/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:03.353274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.353594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.353838 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.384172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] MFA Rules not processed for user `5a3a83e3a19846fd8ddd60ae0f9f4fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:03.385608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:03.477174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1165/2323] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:03 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:03.488938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:03.490821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:03.593079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05fef-f1dd-4a1e-abe8-36c64298f163 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:03.605779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e62f-c1c9-4787-8d3e-4f4eaad838fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:03.606449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e62f-c1c9-4787-8d3e-4f4eaad838fc service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:03.606736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e62f-c1c9-4787-8d3e-4f4eaad838fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:03.607017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e62f-c1c9-4787-8d3e-4f4eaad838fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:03.704982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0e62f-c1c9-4787-8d3e-4f4eaad838fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:03.706463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0e62f-c1c9-4787-8d3e-4f4eaad838fc service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:03.718722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1159/2324] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:03 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:11.512939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:11.514508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:11.525930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116d48-7b9f-4d61-831a-6a3833b8a7da None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:11.529482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49035121-b24d-48d4-a616-4cc64a505253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:11.530108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49035121-b24d-48d4-a616-4cc64a505253 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:11.530384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49035121-b24d-48d4-a616-4cc64a505253 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:11.530651 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49035121-b24d-48d4-a616-4cc64a505253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:11.539605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49035121-b24d-48d4-a616-4cc64a505253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:11.541011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49035121-b24d-48d4-a616-4cc64a505253 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:11.550946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1166/2325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:11 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:19.970694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebe3a-cc8d-4aac-9a7e-374da08f72ee None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:19.971331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebe3a-cc8d-4aac-9a7e-374da08f72ee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:19.971331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebe3a-cc8d-4aac-9a7e-374da08f72ee None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:19.973864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1160/2326] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:19:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 14 03:19:19.995175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0348f7-abb2-4028-9c8c-1e31adb83e6b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:19.995660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0348f7-abb2-4028-9c8c-1e31adb83e6b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:19.995843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0348f7-abb2-4028-9c8c-1e31adb83e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:20.050540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-fa0348f7-abb2-4028-9c8c-1e31adb83e6b None None] MFA Rules not processed for user `b1d2810610e748859ea9ff10d45190b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:20.051883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-fa0348f7-abb2-4028-9c8c-1e31adb83e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:20.130030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1167/2327] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:19:19 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:20.143332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebe3a-cc8d-4aac-9a7e-374da08f72ee None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:20.145082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b3bebe3a-cc8d-4aac-9a7e-374da08f72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:20.222352 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebe3a-cc8d-4aac-9a7e-374da08f72ee None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:20.225850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5ce64-4123-401d-b1cb-277d1d64a97a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9f0d0a342649658a174da2d495fe8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:20.226474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ce64-4123-401d-b1cb-277d1d64a97a service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:20.226757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ce64-4123-401d-b1cb-277d1d64a97a service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:20.227052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ce64-4123-401d-b1cb-277d1d64a97a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:20.236831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5ce64-4123-401d-b1cb-277d1d64a97a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:20.239157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5ce64-4123-401d-b1cb-277d1d64a97a service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:20.249543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1161/2328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:20.314276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fab6e-5ee5-4444-a7d9-bcb3da0c5ee6 None None] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:20.314565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fab6e-5ee5-4444-a7d9-bcb3da0c5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:20.314866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fab6e-5ee5-4444-a7d9-bcb3da0c5ee6 None None] PATH_INFO: `/` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:20.316698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1168/2329] 10.222.0.43 () {54 vars in 921 bytes} [Tue Dec 14 03:19:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 14 03:19:20.321615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:20.321901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:20.322180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:20.340091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] MFA Rules not processed for user `5f08db48e9814f7db34ffcf7d581fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:20.341291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:20.392150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1162/2330] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Dec 14 03:19:20 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:20.404972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fab6e-5ee5-4444-a7d9-bcb3da0c5ee6 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:20.406612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-fc2fab6e-5ee5-4444-a7d9-bcb3da0c5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:20.420274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fab6e-5ee5-4444-a7d9-bcb3da0c5ee6 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:20.423885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58675f4-706b-4460-a0ab-7f681a4d4268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:20.424504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58675f4-706b-4460-a0ab-7f681a4d4268 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:20.424782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58675f4-706b-4460-a0ab-7f681a4d4268 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:20.425052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58675f4-706b-4460-a0ab-7f681a4d4268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:20.431935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58675f4-706b-4460-a0ab-7f681a4d4268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:20.433352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58675f4-706b-4460-a0ab-7f681a4d4268 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:20.441044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1169/2331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:30.977818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:30.979389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:30.990295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2eb5-ef7b-4546-8e1d-e6981cfac338 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:30.993882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:30.994520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:30.994794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:30.995102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:30.996799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:31.010001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:31.011436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:31.021792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1163/2332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:32.413539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:32.414084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:32.414084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:32.432053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:32.433231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:32.485083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1170/2333] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:19:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:32.498108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:32.499522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:32.565566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c338ce2-73dc-4b18-8860-062a411febf9 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:32.570547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:32.571232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:32.571514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:32.571788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:32.579602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:32.581190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:32.588937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1164/2334] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:19:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:19:34.564989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:34.579371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b82a8-1db0-4c41-b368-2b1cf3377c23 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:34.583170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:34.584034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:34.584473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:34.585040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:34.587513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:34.603927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:34.605785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:34.618296 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1171/2335] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:19:51.060192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:51.061615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:51.076496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c7ef6-d999-4c45-b3c5-c67173b28964 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:51.081866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:51.082480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:51.082758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:51.083029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:51.084750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:51.142722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:51.144868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18247754-fc78-4858-89ac-e791e0f88f3c service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:51.155311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1165/2336] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:51 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:53.849579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:53.912615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04308e-bf2e-403f-b474-bca5a4e0e989 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:53.918276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:53.919206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:53.919488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:53.919761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] PATH_INFO: `/v3/users/a8865953a5ea440b864fd3f55c9b5f2f` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:53.921004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8865953a5ea440b864fd3f55c9b5f2f)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:53.922961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:53.966614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8865953a5ea440b864fd3f55c9b5f2f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:53.967318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8865953a5ea440b864fd3f55c9b5f2f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:53.978833 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8865953a5ea440b864fd3f55c9b5f2f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:53.979486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8865953a5ea440b864fd3f55c9b5f2f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:53.986103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8865953a5ea440b864fd3f55c9b5f2f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:53.999609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1172/2337] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:19:53 2021] DELETE /identity/v3/users/a8865953a5ea440b864fd3f55c9b5f2f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:54.004765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:54.005294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:54.005294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:54.023238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:54.024436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:54.079982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1166/2338] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:19:54.093769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:54.095601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:54.157131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7f9de-1449-4a8e-881d-185cc1c00137 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:54.161415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:54.162043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:54.162320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:54.162589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:54.171715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:54.173294 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:54.184151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1173/2339] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:54.455129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:54.456805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:54.468784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65952c44-df1e-4ed7-8edc-d0a5f57c03f2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:54.474860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:54.475757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:54.476044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:54.476320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] PATH_INFO: `/v3/projects/f937350c93bc4d4290e99e19c2ea2d70` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:54.477550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f937350c93bc4d4290e99e19c2ea2d70)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:54.479486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:54.525251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f937350c93bc4d4290e99e19c2ea2d70', 'request_id': 'req-ee15e5fe-f05c-45b2-a471-a445d9184220'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.531195 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f937350c93bc4d4290e99e19c2ea2d70', 'request_id': 'req-ee15e5fe-f05c-45b2-a471-a445d9184220'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.538594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f937350c93bc4d4290e99e19c2ea2d70', 'request_id': 'req-ee15e5fe-f05c-45b2-a471-a445d9184220'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.548883 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] The token cache is being invalidate because project f937350c93bc4d4290e99e19c2ea2d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:19:54.550588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.551278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.553582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1167/2340] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:19:54 2021] DELETE /identity/v3/projects/f937350c93bc4d4290e99e19c2ea2d70 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:54.556766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:54.566303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a403ab2-8765-472a-a2d8-9f7ca60b9269 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:54.621262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:54.622029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:54.622312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:54.622589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] PATH_INFO: `/v3/users/5a3a83e3a19846fd8ddd60ae0f9f4fc2` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:54.623840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3a83e3a19846fd8ddd60ae0f9f4fc2)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:54.625758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:54.670528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3a83e3a19846fd8ddd60ae0f9f4fc2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.671213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3a83e3a19846fd8ddd60ae0f9f4fc2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.683287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3a83e3a19846fd8ddd60ae0f9f4fc2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.683940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3a83e3a19846fd8ddd60ae0f9f4fc2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.691082 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-db61e260-fc2b-4f5f-8398-cdfc6181cbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3a83e3a19846fd8ddd60ae0f9f4fc2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:54.702683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1174/2341] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:19:54 2021] DELETE /identity/v3/users/5a3a83e3a19846fd8ddd60ae0f9f4fc2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:19:55.026248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.027758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:55.040378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15e5fe-f05c-45b2-a471-a445d9184220 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.095510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.096353 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.097371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.097687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] PATH_INFO: `/v3/projects/fa764459cc0b4544bd81a9fb59608133` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.098927 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa764459cc0b4544bd81a9fb59608133)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.100836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.144517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa764459cc0b4544bd81a9fb59608133', 'request_id': 'req-579e4552-cf95-4009-92f2-4961730c3587'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:55.150437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa764459cc0b4544bd81a9fb59608133', 'request_id': 'req-579e4552-cf95-4009-92f2-4961730c3587'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:55.157827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa764459cc0b4544bd81a9fb59608133', 'request_id': 'req-579e4552-cf95-4009-92f2-4961730c3587'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:55.169547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] The token cache is being invalidate because project fa764459cc0b4544bd81a9fb59608133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:19:55.169834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:55.170450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-579e4552-cf95-4009-92f2-4961730c3587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:19:55.171975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1168/2342] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:19:55 2021] DELETE /identity/v3/projects/fa764459cc0b4544bd81a9fb59608133 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:55.179077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.179570 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.179672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.197538 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:55.198744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:55.256031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1175/2343] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:55.263725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.264016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.264289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.283240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:55.284411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:55.292474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1169/2344] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:19:55.296649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.306167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da71662-77ed-431e-b6f8-b61502e2f191 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.310735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.311406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.311701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.312007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.312710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:19:55.313018 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.314620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.326613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1176/2345] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:19:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:19:55.331442 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.340624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad424f9-2d29-4075-a00e-30a929d3a3bf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.345367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.346013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.346301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.346743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.347555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.349474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.375359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1170/2346] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:55.379841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.390922 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ac8d-58bd-4387-a411-008687a7f389 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.448387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.449045 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.449331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.449608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.450313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.452254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.470835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1177/2347] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:55.474842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.484766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83900-eff6-4d14-89ce-f6a55ac647e3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.490533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.491328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.491614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.491897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.492631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.494444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.505721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1171/2348] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:55.509661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.520577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730688b-814f-46f9-9ef6-8bbbf24fd2b9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.525481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0753516-e154-440c-a726-6d1d1bca1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.526143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753516-e154-440c-a726-6d1d1bca1d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.526427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753516-e154-440c-a726-6d1d1bca1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.526705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753516-e154-440c-a726-6d1d1bca1d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.527489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0753516-e154-440c-a726-6d1d1bca1d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.529108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0753516-e154-440c-a726-6d1d1bca1d80 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.539297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1178/2349] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:55.543558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.553330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0805-2b79-47ca-9755-1465ea92aa5f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.557993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.558987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.559299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.559579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] PATH_INFO: `/v3/projects/78b9592954fd41b993868a91d403a936/users/b418e8c97e2e431186ec18cb528a0c3b/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.575707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b9592954fd41b993868a91d403a936, user_id=b418e8c97e2e431186ec18cb528a0c3b, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.578330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.591412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1172/2350] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:19:55 2021] PUT /identity/v3/projects/78b9592954fd41b993868a91d403a936/users/b418e8c97e2e431186ec18cb528a0c3b/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:55.602500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.602792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.603097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.629705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] MFA Rules not processed for user `b418e8c97e2e431186ec18cb528a0c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:55.630912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:55.693143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1179/2351] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:55.697555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.756160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a4ed1-84a4-44aa-bb1a-71d34ccbe318 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.760741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.761372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.761650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.761918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.762599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.764489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.788339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1173/2352] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:55.792287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.803645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f19b-5af0-4cb4-96b2-4a1ca25e4294 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.858450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.859131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.859440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.859714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.860404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.862341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.882333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1180/2353] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:19:55 2021] POST /identity/v3/users => generated 306 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:19:55.886421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.896928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b124e-129e-4981-85ed-a35c1c5ce445 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.901528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.902173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.902455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.902731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.903497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.905093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.915860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1174/2354] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:55.919829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.929403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45fc1b-bb77-4e56-b7a8-c248e8e95519 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:55.934004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:55.934859 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:55.935183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:55.935464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] PATH_INFO: `/v3/projects/c234c9524db34caeaa97556891588ae5/users/c1fb033bb5bf46cfafcd6881d7fe6a0b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:55.950031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c234c9524db34caeaa97556891588ae5, user_id=c1fb033bb5bf46cfafcd6881d7fe6a0b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:55.952715 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:55.966087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1181/2355] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:19:55 2021] PUT /identity/v3/projects/c234c9524db34caeaa97556891588ae5/users/c1fb033bb5bf46cfafcd6881d7fe6a0b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:55.970158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:55.980405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2a686-15ad-4f47-b247-32be3d00b675 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:56.035815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bf65f-f7dc-4132-8f54-be4ec4185fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:56.036531 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bf65f-f7dc-4132-8f54-be4ec4185fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:56.036741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bf65f-f7dc-4132-8f54-be4ec4185fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:56.037016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bf65f-f7dc-4132-8f54-be4ec4185fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:56.037771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bf65f-f7dc-4132-8f54-be4ec4185fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:56.039370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bf65f-f7dc-4132-8f54-be4ec4185fe5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:56.049286 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1175/2356] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:19:56.053429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:56.063825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f21225-563f-4f3e-b5a2-8696645f6406 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:56.069210 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:56.070086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:56.070367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:56.070645 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] PATH_INFO: `/v3/projects/c234c9524db34caeaa97556891588ae5/users/c1fb033bb5bf46cfafcd6881d7fe6a0b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:56.072736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c234c9524db34caeaa97556891588ae5, user_id=c1fb033bb5bf46cfafcd6881d7fe6a0b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:56.075392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:56.086560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1182/2357] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:19:56 2021] PUT /identity/v3/projects/c234c9524db34caeaa97556891588ae5/users/c1fb033bb5bf46cfafcd6881d7fe6a0b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:19:56.096564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696715-db20-46b2-bc23-96649995c50d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:56.096841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696715-db20-46b2-bc23-96649995c50d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:56.097124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696715-db20-46b2-bc23-96649995c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:56.124401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a8696715-db20-46b2-bc23-96649995c50d None None] MFA Rules not processed for user `c1fb033bb5bf46cfafcd6881d7fe6a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:19:56.125640 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a8696715-db20-46b2-bc23-96649995c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:56.190498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1176/2358] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:19:56 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:19:56.200446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:56.202025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:56.256744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880fad2-40c7-4365-8ad9-964959a9dcf0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:56.260345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:56.260958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:56.261236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:56.261507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:56.270125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:56.271575 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:56.280491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1183/2359] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:56 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:56.353196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696715-db20-46b2-bc23-96649995c50d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:56.362539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696715-db20-46b2-bc23-96649995c50d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:56.366888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:56.367543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:56.367873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:56.368129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:56.428128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:56.429561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:56.438220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1177/2360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:56 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:56.536344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:56.538151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:56.604141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051392e-a4b4-4112-a3e4-7e2cf73ba3a6 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:56.608056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:56.608836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:56.609167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:56.611191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:56.612546 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:56.623968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:56.625386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:56.633604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1184/2361] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:19:59.527800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:19:59.529532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:59.632291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047fce-9a7f-44ed-a60f-a756c9133fc4 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:19:59.637570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:19:59.638217 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:19:59.638502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:19:59.638780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:19:59.640597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:19:59.654296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:19:59.656108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26663b-3b10-433d-9b66-c52fa6f5395c service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:19:59.667440 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1178/2362] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:19:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:20:00.426808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:00.487237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e341c0c-f02a-4281-a704-4d2e0ef31f2d service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:00.492169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:00.493025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:00.493305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:00.493695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] PATH_INFO: `/v3/users/b418e8c97e2e431186ec18cb528a0c3b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:00.494891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b418e8c97e2e431186ec18cb528a0c3b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:00.496842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:00.540539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b418e8c97e2e431186ec18cb528a0c3b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:00.541122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b418e8c97e2e431186ec18cb528a0c3b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:00.552562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b418e8c97e2e431186ec18cb528a0c3b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:00.553302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b418e8c97e2e431186ec18cb528a0c3b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:00.559741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b418e8c97e2e431186ec18cb528a0c3b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:00.571993 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1185/2363] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:00 2021] DELETE /identity/v3/users/b418e8c97e2e431186ec18cb528a0c3b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:00.576566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:00.577040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:00.577157 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:00.594296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:00.595517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:00.651801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1179/2364] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:00.663125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:00.664524 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:00.721762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d581dc-fa5e-45c6-97b1-24e1145a559e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:00.725980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:00.726611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:00.726891 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:00.727202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:00.736418 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:00.738713 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:00.748778 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1186/2365] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:01.008348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.009810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:01.021265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdaa2a-cd0d-4a89-acf2-db4219ca4d1a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:01.026093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:01.026950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.027278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.027558 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] PATH_INFO: `/v3/projects/78b9592954fd41b993868a91d403a936` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.028863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b9592954fd41b993868a91d403a936)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:01.030826 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:01.078130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b9592954fd41b993868a91d403a936', 'request_id': 'req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.084351 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b9592954fd41b993868a91d403a936', 'request_id': 'req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.092858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b9592954fd41b993868a91d403a936', 'request_id': 'req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.103509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] The token cache is being invalidate because project 78b9592954fd41b993868a91d403a936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:01.103799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.104460 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.106034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1180/2366] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:01 2021] DELETE /identity/v3/projects/78b9592954fd41b993868a91d403a936 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:01.109984 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.120491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcb56-8f3f-4af2-94e5-c9240fbc1afa service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:01.176201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:01.177144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.177427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.177700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] PATH_INFO: `/v3/users/c1fb033bb5bf46cfafcd6881d7fe6a0b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.178921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fb033bb5bf46cfafcd6881d7fe6a0b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:01.180883 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:01.228076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fb033bb5bf46cfafcd6881d7fe6a0b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.228769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fb033bb5bf46cfafcd6881d7fe6a0b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.241155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fb033bb5bf46cfafcd6881d7fe6a0b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.241885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fb033bb5bf46cfafcd6881d7fe6a0b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.249579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-24ad9c55-3e64-4692-b28f-e17f364b1d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fb033bb5bf46cfafcd6881d7fe6a0b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.263860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1187/2367] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:01 2021] DELETE /identity/v3/users/c1fb033bb5bf46cfafcd6881d7fe6a0b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:01.546994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.548482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:01.570752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75a153-bfb9-4688-bd1f-ad0dd28a174d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:01.628712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:01.629468 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.629751 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.630028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] PATH_INFO: `/v3/projects/c234c9524db34caeaa97556891588ae5` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.631282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c234c9524db34caeaa97556891588ae5)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:01.633237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:01.680942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c234c9524db34caeaa97556891588ae5', 'request_id': 'req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.687285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c234c9524db34caeaa97556891588ae5', 'request_id': 'req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.694627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c234c9524db34caeaa97556891588ae5', 'request_id': 'req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.704646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] The token cache is being invalidate because project c234c9524db34caeaa97556891588ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:01.704931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.705545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c11c0c9b-8fe4-4bad-a5c0-978e255e7f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:01.707636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1181/2368] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:01 2021] DELETE /identity/v3/projects/c234c9524db34caeaa97556891588ae5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:01.713258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.713725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.713968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.732637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:01.733827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:01.791973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1188/2369] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:01.800040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.800433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.800774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.820511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:01.821787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:01.830691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1182/2370] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:01.835002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.845698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bfd2e-9df8-4b1b-a12b-be43353b6ead None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:01.851640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:01.853893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.853893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.853893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.854260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:01.854597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:01.857067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:01.871087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1189/2371] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:20:01.875603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.885040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534cc64-71df-41a9-986b-a7f624116565 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:01.890152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:01.890798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:01.891132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:01.891410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:01.892107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:01.893979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:01.921860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1183/2372] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:01 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:01.926008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.935807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91f6d-adf8-423b-b4d7-df06e4501ee9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:01.995132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:01.997450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.001190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.001885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.002308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.002593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.003343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.006712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.013877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d743f-7e0a-431e-8f16-7feb15dfab9c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.018847 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.020304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.020616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.020996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] PATH_INFO: `/v3/users/0a133cb1175e4130902bbcdeaedd74f9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.022245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a133cb1175e4130902bbcdeaedd74f9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.024215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.029067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1190/2373] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:01 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:02.033086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.042890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f63e3-26e6-4d50-9441-da4a39ce7c96 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.048020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.048751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.049106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.049451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.050200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.051861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.067227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1191/2374] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:02.069510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.079808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838c14-82fb-4833-a051-93de68ff1f5b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.085100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.085737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.086023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.086299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.087025 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.088644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.089186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a133cb1175e4130902bbcdeaedd74f9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.096074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a133cb1175e4130902bbcdeaedd74f9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.096755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a133cb1175e4130902bbcdeaedd74f9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.099864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1192/2375] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:02.104062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.105986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.109402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a133cb1175e4130902bbcdeaedd74f9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.118639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b997b806-0ca5-4180-ad58-e2d9d567ab81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a133cb1175e4130902bbcdeaedd74f9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.119489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f678db8-15f5-42ad-8fb9-c75046320dd3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.124470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.125133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1184/2376] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:01 2021] DELETE /identity/v3/users/0a133cb1175e4130902bbcdeaedd74f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:02.125521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.125865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.126204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] PATH_INFO: `/v3/projects/a3bf5b304f66426f985a7a3a3963983f/users/694bd70ec4ff4ce0b918de14e9e4e130/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.140823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3bf5b304f66426f985a7a3a3963983f, user_id=694bd70ec4ff4ce0b918de14e9e4e130, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.143398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.156333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1193/2377] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:02 2021] PUT /identity/v3/projects/a3bf5b304f66426f985a7a3a3963983f/users/694bd70ec4ff4ce0b918de14e9e4e130/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:02.168586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.169080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.169366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.196772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] MFA Rules not processed for user `694bd70ec4ff4ce0b918de14e9e4e130`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:02.197987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.260963 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1185/2378] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:02.272250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.273974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.293128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.294722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.335226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8386da-386c-486b-bc99-f68cd321020f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.338956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.339620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.339899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.340172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.348509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.350011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.359080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1194/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:02.362009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62e15-8083-42e0-8dea-c5db22788083 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.367623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.368522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.368805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.369078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] PATH_INFO: `/v3/projects/7ecea5c13a624ab8a3a445d3ede5fd77` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.370295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecea5c13a624ab8a3a445d3ede5fd77)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.372264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.385878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.396633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e41ee-b3e4-45fc-9842-89c1d50519c9 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.401291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.402280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.402563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.402839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] PATH_INFO: `/v3/users/694bd70ec4ff4ce0b918de14e9e4e130` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.404086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694bd70ec4ff4ce0b918de14e9e4e130)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.405991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.418249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecea5c13a624ab8a3a445d3ede5fd77', 'request_id': 'req-5434c10f-124b-48ef-a726-8b8af53ae177'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.424175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecea5c13a624ab8a3a445d3ede5fd77', 'request_id': 'req-5434c10f-124b-48ef-a726-8b8af53ae177'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.432706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecea5c13a624ab8a3a445d3ede5fd77', 'request_id': 'req-5434c10f-124b-48ef-a726-8b8af53ae177'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.444119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] The token cache is being invalidate because project 7ecea5c13a624ab8a3a445d3ede5fd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:02.444407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.445092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5434c10f-124b-48ef-a726-8b8af53ae177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.447127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1186/2380] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:02 2021] DELETE /identity/v3/projects/7ecea5c13a624ab8a3a445d3ede5fd77 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:02.452389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734cb7d-8281-48dd-ae57-64bab2c486fc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.452681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734cb7d-8281-48dd-ae57-64bab2c486fc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.452956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734cb7d-8281-48dd-ae57-64bab2c486fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.453132 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694bd70ec4ff4ce0b918de14e9e4e130'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.453805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694bd70ec4ff4ce0b918de14e9e4e130'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.465846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694bd70ec4ff4ce0b918de14e9e4e130'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.466607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694bd70ec4ff4ce0b918de14e9e4e130'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.472605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0734cb7d-8281-48dd-ae57-64bab2c486fc None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:02.474111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0734cb7d-8281-48dd-ae57-64bab2c486fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.474246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-875e5092-4c10-4600-b148-b24ee6111ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694bd70ec4ff4ce0b918de14e9e4e130'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:02.486464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1195/2381] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:02 2021] DELETE /identity/v3/users/694bd70ec4ff4ce0b918de14e9e4e130 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:02.491663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.491947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.492221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.509888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:02.511089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.532551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1187/2382] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:02.541019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.541411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.541697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.559922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:02.561141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.582758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1196/2383] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:02.592558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.593962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.621312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1188/2384] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:02.625410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.634610 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7272-b2f2-4a86-9abc-954112f022f8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.639397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.640033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.640313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.640588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.641315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:02.641623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.643230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.652741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd69e5-4735-4f79-a3dd-346baeac17b4 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.655019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1189/2385] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:20:02.656733 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.657419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.657700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.657989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.659585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.668419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.669861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.670295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae4b23-14e1-421a-b2e1-1b28583ec2b0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.675545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.676193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.676470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.676744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.677443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.679337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.679625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1197/2386] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:20:02.704649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1190/2387] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:02.709479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.720337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2589b2-e609-48a7-a5ee-784cb82ecd7b service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.779983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.780666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.780945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.781232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.781915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.783865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.805480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1198/2388] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:02.806669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.825108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0065d1-4972-4c2e-b1ad-ac77862aaee3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.830528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.831320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.832252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.832599 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.833407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.835094 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.845313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1191/2389] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:02.849901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.859807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ae5ff-1dd2-48e1-bb89-87eda71dec26 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.865341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8499-9876-41b8-9145-1aaeb569e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.865990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8499-9876-41b8-9145-1aaeb569e941 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.866270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8499-9876-41b8-9145-1aaeb569e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.866576 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8499-9876-41b8-9145-1aaeb569e941 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.867342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8499-9876-41b8-9145-1aaeb569e941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.868943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8499-9876-41b8-9145-1aaeb569e941 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.882473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1199/2390] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:20:02.884211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.897908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a07e-7665-44bd-a8e1-5599cdeb3505 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:02.903083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:02.903911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.904188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.904451 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] PATH_INFO: `/v3/projects/fcf932b53cde41bc84ba2b2f3e03aafa/users/57ebca6b2f504965841e152882a52507/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.919296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf932b53cde41bc84ba2b2f3e03aafa, user_id=57ebca6b2f504965841e152882a52507, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:02.922026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:02.936848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1192/2391] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:02 2021] PUT /identity/v3/projects/fcf932b53cde41bc84ba2b2f3e03aafa/users/57ebca6b2f504965841e152882a52507/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:02.948217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:02.948582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:02.949084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:02.956211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:02.959529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:02.982150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] MFA Rules not processed for user `57ebca6b2f504965841e152882a52507`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:02.983290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.026039 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b87da-7bc4-4784-b5ad-916e5e1d8587 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.030882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.032072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.032205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.032457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] PATH_INFO: `/v3/projects/a3bf5b304f66426f985a7a3a3963983f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.033802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3bf5b304f66426f985a7a3a3963983f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.035878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.048327 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1200/2392] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:03.059549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.060924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.083840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3bf5b304f66426f985a7a3a3963983f', 'request_id': 'req-264c0403-697d-4cd6-a305-d3ac2d6c52d6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:03.090035 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3bf5b304f66426f985a7a3a3963983f', 'request_id': 'req-264c0403-697d-4cd6-a305-d3ac2d6c52d6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:03.098586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3bf5b304f66426f985a7a3a3963983f', 'request_id': 'req-264c0403-697d-4cd6-a305-d3ac2d6c52d6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:03.111785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] The token cache is being invalidate because project a3bf5b304f66426f985a7a3a3963983f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:03.112203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:03.113569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-264c0403-697d-4cd6-a305-d3ac2d6c52d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:03.115274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1193/2393] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:02 2021] DELETE /identity/v3/projects/a3bf5b304f66426f985a7a3a3963983f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:03.121437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688152-23c1-4b08-8bc2-95dd2df828a3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.121717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688152-23c1-4b08-8bc2-95dd2df828a3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.121987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688152-23c1-4b08-8bc2-95dd2df828a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.140365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4b688152-23c1-4b08-8bc2-95dd2df828a3 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:03.141582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4b688152-23c1-4b08-8bc2-95dd2df828a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.154797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e37ae-c84c-4775-ba80-4c167bd59b17 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.202968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1194/2394] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:03.210854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.211411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.211761 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.228080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.228758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.229035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.229308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.231158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.236235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:03.237544 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.250301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1195/2395] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:03.251159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.260584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777b44-65d1-482b-8204-e49104aefe0f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.265219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.265847 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.266135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.266416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.267193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:03.268530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.270148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.281320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1196/2396] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:20:03.285421 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.290098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.291736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.294740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d8a35-9bd3-4049-96aa-e55caf1fd528 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.299416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.300031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.300851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.301126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1201/2397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:03 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:20:03.301311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.301812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.303704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.333029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1197/2398] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:03 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:03.334003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.343991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60628ad-f273-46ed-8094-2c61647e2219 service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.400299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.400956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.401264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.401537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.402243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.404193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.424070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1202/2399] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:03 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:03.428523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.438792 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92ea74-7505-402f-9b69-1bec3f7c6254 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.444575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.445240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.445526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.445803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.446542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.448172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.459848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1198/2400] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:20:03.463764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.474988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2ad25-d420-4900-9ee1-cd71281a7e9f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.480211 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ffa5-aabd-4c22-af56-ecadafa8df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.480870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ffa5-aabd-4c22-af56-ecadafa8df89 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.481271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ffa5-aabd-4c22-af56-ecadafa8df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.481569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ffa5-aabd-4c22-af56-ecadafa8df89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.482292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9ffa5-aabd-4c22-af56-ecadafa8df89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.483954 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9ffa5-aabd-4c22-af56-ecadafa8df89 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.494484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1203/2401] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:03.498370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.508973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9157-cd9f-428a-8fc2-7ba2b976afd8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.516734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.518469 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.519648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.520127 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] PATH_INFO: `/v3/projects/325c78a0c8574ce0bb38f768705a1181/users/e9bfec4b3f8b47cf93f7d07703365d1a/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.535517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] RBAC: Authorizing `identity:create_grant(project_id=325c78a0c8574ce0bb38f768705a1181, user_id=e9bfec4b3f8b47cf93f7d07703365d1a, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.538160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.555894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1199/2402] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:03 2021] PUT /identity/v3/projects/325c78a0c8574ce0bb38f768705a1181/users/e9bfec4b3f8b47cf93f7d07703365d1a/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:03.560949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc78c-c2cd-46af-a9c7-c6adcf694dc5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.561319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc78c-c2cd-46af-a9c7-c6adcf694dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.561730 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc78c-c2cd-46af-a9c7-c6adcf694dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.583361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-bdfbc78c-c2cd-46af-a9c7-c6adcf694dc5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:03.584540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-bdfbc78c-c2cd-46af-a9c7-c6adcf694dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.662273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1204/2403] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:03.670123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:03.671980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:03.728499 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe0f1-a054-4b1c-8107-393c9fdc287f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:03.732113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:03.732747 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:03.733034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:03.733311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:03.743029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:03.744465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:03.753893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1200/2404] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:20:04.359425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4cde-d57e-411b-a38e-cc4a1b4be126 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:04.359925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4cde-d57e-411b-a38e-cc4a1b4be126 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:04.360017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4cde-d57e-411b-a38e-cc4a1b4be126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:04.392675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-57eb4cde-d57e-411b-a38e-cc4a1b4be126 None None] MFA Rules not processed for user `e9bfec4b3f8b47cf93f7d07703365d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:04.394766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-57eb4cde-d57e-411b-a38e-cc4a1b4be126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:04.468681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1205/2405] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:04.478870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:04.480321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:04.536659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db713b7e-6064-47b1-823f-7336893bca9a service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:04.540147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:04.540772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:04.541049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:04.541319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:04.549266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:04.551372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:04.559835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1201/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:04 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:05.889266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:05.889731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:05.889844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:05.908649 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] MFA Rules not processed for user `e9bfec4b3f8b47cf93f7d07703365d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:05.910401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:05.917161 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1206/2407] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:06.140066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:06.141500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:06.153612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1964fa7-c78e-42ba-aff1-9da5f46a5cf7 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:06.157178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:06.157827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:06.158109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:06.158385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:06.160667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:06.169581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:06.170981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:06.179204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1202/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:06 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:06.471222 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:06.473405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:06.540932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c6002-ec72-4395-8ec2-c83606a68213 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:06.545804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:06.546430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:06.546708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:06.546980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:06.548725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:06.559580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:06.561374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:06.570944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1207/2409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:20:12.257495 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:12.259203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:12.336949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ddec7-8097-4de4-9cac-fad9aa86c88a service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:12.342633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:12.343298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:12.343626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:12.343902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:12.345679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:12.359606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:12.361176 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1855f18-2013-436a-8a23-173b9a294b3b service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:12.372431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1203/2410] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:12.653571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:12.659174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:12.675819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7af30-ae72-4b02-92bf-e265d3bf86fa service placement] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:12.680630 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:12.681519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:12.681803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:12.682080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] PATH_INFO: `/v3/users/57ebca6b2f504965841e152882a52507` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:12.683308 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ebca6b2f504965841e152882a52507)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:12.685227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:12.733111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ebca6b2f504965841e152882a52507'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:12.733768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ebca6b2f504965841e152882a52507'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:12.745800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ebca6b2f504965841e152882a52507'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:12.746427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ebca6b2f504965841e152882a52507'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:12.754049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ebca6b2f504965841e152882a52507'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:12.766156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1208/2411] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:12 2021] DELETE /identity/v3/users/57ebca6b2f504965841e152882a52507 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:12.770800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:12.771130 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:12.771404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:12.788330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:12.789438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:12.844954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1204/2412] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:12.855226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:12.856653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:12.916636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5e21-3739-4a7f-bfea-0ac03da19bd9 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:12.920255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8c8af-bfaa-4d03-ae82-e116a4874f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:12.920882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8c8af-bfaa-4d03-ae82-e116a4874f7e service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:12.921162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8c8af-bfaa-4d03-ae82-e116a4874f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:12.921431 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8c8af-bfaa-4d03-ae82-e116a4874f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:12.931358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8c8af-bfaa-4d03-ae82-e116a4874f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:12.932879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8c8af-bfaa-4d03-ae82-e116a4874f7e service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:12.942357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1209/2413] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:13.275263 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.276777 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:13.296232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29c7b4-ad91-4fd9-b444-6f300e1edb21 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.302679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.303577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.303890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.304110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] PATH_INFO: `/v3/projects/fcf932b53cde41bc84ba2b2f3e03aafa` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.305328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf932b53cde41bc84ba2b2f3e03aafa)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.307287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.351652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf932b53cde41bc84ba2b2f3e03aafa', 'request_id': 'req-133f4cdb-b1be-4f58-9566-cc8e6afa7881'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:13.357380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf932b53cde41bc84ba2b2f3e03aafa', 'request_id': 'req-133f4cdb-b1be-4f58-9566-cc8e6afa7881'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:13.365021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf932b53cde41bc84ba2b2f3e03aafa', 'request_id': 'req-133f4cdb-b1be-4f58-9566-cc8e6afa7881'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:13.375028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] The token cache is being invalidate because project fcf932b53cde41bc84ba2b2f3e03aafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:13.375344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:13.375970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-133f4cdb-b1be-4f58-9566-cc8e6afa7881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:13.377486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1205/2414] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:13 2021] DELETE /identity/v3/projects/fcf932b53cde41bc84ba2b2f3e03aafa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:13.383807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.384118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.384400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.402877 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:13.404094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:13.460604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1210/2415] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:13.468493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.468782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.469061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.489184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:13.490372 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:13.498132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1206/2416] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:13.503800 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.513179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377853f-1242-41b0-98bb-86ce5b2a368e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.517670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.518297 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.519108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.519382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.520098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:13.520398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.521965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.532920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1211/2417] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:20:13.537628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.546564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3c4cf-8812-4763-9907-7a7a85df16fd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.551325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.551948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.552229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.552502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.553201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.555096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.579588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1207/2418] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:13 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:13.584135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.594042 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83283f42-0dd4-412d-b42f-45a1cab86686 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.647213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.647787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.648062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.648331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.649020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.650905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.669975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1212/2419] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:13 2021] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:13.674192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.684600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145762d-198b-4bb1-a46d-f5ab20681ff8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.689295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.689941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.690223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.691010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.691766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.693347 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.703813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1208/2420] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:20:13.708373 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.717803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789026-570b-4535-8ba2-92e827648dd3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.722467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e951d8-c160-474f-b9ad-fe7300276057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.723135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e951d8-c160-474f-b9ad-fe7300276057 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.723433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e951d8-c160-474f-b9ad-fe7300276057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.723692 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e951d8-c160-474f-b9ad-fe7300276057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.724424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e951d8-c160-474f-b9ad-fe7300276057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.726004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e951d8-c160-474f-b9ad-fe7300276057 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.735884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1213/2421] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:13.740247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.750256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b481-5001-41a7-a0c1-a3fb8152962d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.755674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.756567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.756848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.757122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] PATH_INFO: `/v3/projects/d15cda26843f4a28842bed5262708115/users/9cd66f1b0eed4918b7e9af0c0bacb554/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.772444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15cda26843f4a28842bed5262708115, user_id=9cd66f1b0eed4918b7e9af0c0bacb554, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.775122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:13.788268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1209/2422] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:13 2021] PUT /identity/v3/projects/d15cda26843f4a28842bed5262708115/users/9cd66f1b0eed4918b7e9af0c0bacb554/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:13.798058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.798342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.798613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.825133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] MFA Rules not processed for user `9cd66f1b0eed4918b7e9af0c0bacb554`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:13.826528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:13.889936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1214/2423] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:13.901901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:13.903600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:13.974547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971b9a-a9cb-4abe-a795-72a880276318 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:13.980646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec408a-0445-4a56-ba6a-0b0644fc3ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:13.981278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec408a-0445-4a56-ba6a-0b0644fc3ed2 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:13.981563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec408a-0445-4a56-ba6a-0b0644fc3ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:13.981838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec408a-0445-4a56-ba6a-0b0644fc3ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:13.989972 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec408a-0445-4a56-ba6a-0b0644fc3ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:13.991566 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec408a-0445-4a56-ba6a-0b0644fc3ed2 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:14.000058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1210/2424] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:14.167284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:14.232527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc25b23-124d-4617-b228-77eb73d2f1b3 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:14.237121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:14.238759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.239051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.239343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] PATH_INFO: `/v3/users/9cd66f1b0eed4918b7e9af0c0bacb554` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.240518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd66f1b0eed4918b7e9af0c0bacb554)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:14.242416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:14.284756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd66f1b0eed4918b7e9af0c0bacb554'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.285402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd66f1b0eed4918b7e9af0c0bacb554'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.296629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd66f1b0eed4918b7e9af0c0bacb554'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.297285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd66f1b0eed4918b7e9af0c0bacb554'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.306225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd66f1b0eed4918b7e9af0c0bacb554'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.319242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1215/2425] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:14 2021] DELETE /identity/v3/users/9cd66f1b0eed4918b7e9af0c0bacb554 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:14.323760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.324226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.324323 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.341281 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:14.342465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:14.404477 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1211/2426] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:14.414701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:14.416122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:14.472658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b85e8-6677-4d11-8847-232d4ebd01ac admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:14.476322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68685-2385-48aa-9aba-ffc15909f613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:14.476953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68685-2385-48aa-9aba-ffc15909f613 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.477234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68685-2385-48aa-9aba-ffc15909f613 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.477509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68685-2385-48aa-9aba-ffc15909f613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.486384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d68685-2385-48aa-9aba-ffc15909f613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:14.488711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d68685-2385-48aa-9aba-ffc15909f613 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:14.498040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1216/2427] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:14.751140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:14.752779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:14.765370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad568-49a2-4b4e-ad62-79b2c2375ef1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:14.770550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:14.771504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.771787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.772163 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] PATH_INFO: `/v3/projects/d15cda26843f4a28842bed5262708115` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.773502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15cda26843f4a28842bed5262708115)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:14.775849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:14.821104 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15cda26843f4a28842bed5262708115', 'request_id': 'req-bb812a02-9089-4366-aa95-c2ed01fa5091'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.827074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15cda26843f4a28842bed5262708115', 'request_id': 'req-bb812a02-9089-4366-aa95-c2ed01fa5091'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.834407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15cda26843f4a28842bed5262708115', 'request_id': 'req-bb812a02-9089-4366-aa95-c2ed01fa5091'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.844116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] The token cache is being invalidate because project d15cda26843f4a28842bed5262708115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:14.844397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.845008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bb812a02-9089-4366-aa95-c2ed01fa5091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:14.846514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1212/2428] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:14 2021] DELETE /identity/v3/projects/d15cda26843f4a28842bed5262708115 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:14.852845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc377a-8a10-41c0-9b5a-bb771f64adb8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.853318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc377a-8a10-41c0-9b5a-bb771f64adb8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.853413 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc377a-8a10-41c0-9b5a-bb771f64adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.872453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b9fc377a-8a10-41c0-9b5a-bb771f64adb8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:14.873641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b9fc377a-8a10-41c0-9b5a-bb771f64adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:14.931520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1217/2429] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:14.939512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.939800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.940079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.960520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:14.961732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:14.971258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1213/2430] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:14.971696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.972464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.972741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.975913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:14.986504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55e5c5-85d5-406b-bbb3-8be212d8bbc4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:14.991644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:14.992794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:14.992980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:14.993643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:14.994028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:14.994401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:14.995269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:14.995673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:14.997567 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.011226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1214/2431] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:20:15.014283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.025139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1abe0-ee75-45b3-8735-50a2ca57a1ea admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.030098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.030960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.031543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.031820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.032520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.034426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.060427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1215/2432] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:15 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:15.064507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1218/2433] 10.222.0.43 () {58 vars in 967 bytes} [Tue Dec 14 03:20:14 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:15.064653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.089550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.090960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:15.132456 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f09dd-eb88-476a-9a87-ca00c15285c4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.137158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.137803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.138080 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.138350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.139097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.140955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.157853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e44fd-0867-46e0-b9f4-733ed0e4d495 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.161284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1216/2434] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:15 2021] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:15.165210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.174305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3d4f2-a16c-4d03-9bb3-8d450b190502 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.179813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.180437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.180714 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.180983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.181828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.183378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.193726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1217/2435] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:15.197393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.207112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c5348-ad6e-42a9-a823-f28a4395d35b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.212284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.212911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.213191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.213472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.214207 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.215810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.219168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.219805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.220088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.220384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.225930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1218/2436] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:15.229868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.239873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe597-6394-43c0-b31b-5a8f27b7a75d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.244635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cb15d-8d96-4ced-b4c4-2bc26b471f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.245480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb15d-8d96-4ced-b4c4-2bc26b471f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.245757 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb15d-8d96-4ced-b4c4-2bc26b471f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.246028 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb15d-8d96-4ced-b4c4-2bc26b471f01 admin admin] PATH_INFO: `/v3/projects/b24f5590f7f94bdca6848a5e109242f9/users/177898658c5a46b5aeddd3cf1320b74e/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.260344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cb15d-8d96-4ced-b4c4-2bc26b471f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24f5590f7f94bdca6848a5e109242f9, user_id=177898658c5a46b5aeddd3cf1320b74e, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.263085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cb15d-8d96-4ced-b4c4-2bc26b471f01 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.275712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.276006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1219/2437] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:15 2021] PUT /identity/v3/projects/b24f5590f7f94bdca6848a5e109242f9/users/177898658c5a46b5aeddd3cf1320b74e/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:15.277303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.286450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1219/2438] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:20:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:20:15.288776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.289106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.289410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.316746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] MFA Rules not processed for user `177898658c5a46b5aeddd3cf1320b74e`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:15.317937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:15.385214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1220/2439] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:15 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:15.390482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.402417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260c1d-4ff6-4db2-a98e-2ab75651689a service swift] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.460021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.460682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.460968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.461272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.461976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.464006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.495479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1220/2440] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:15 2021] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:15.500450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.515913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc010b91-589b-4943-a321-dbb5c979f253 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.591690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.592829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.593338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.593846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.595196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.597994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.621766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1221/2441] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:15 2021] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:15.625738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.641581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f59805-be09-42a8-bbbd-2402499b8a65 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.647741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.648477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.648824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.649218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.650050 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.651763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.663666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1221/2442] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:15.667899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.678061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37161-8c36-4200-bde0-e89fd30ff76f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.682910 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.683771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.684052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.684332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] PATH_INFO: `/v3/projects/ff0c51a9efd1409793b0e21a4094ee8a/users/6479ed56336a497eaa40d7e152c05e60/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.699278 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c51a9efd1409793b0e21a4094ee8a, user_id=6479ed56336a497eaa40d7e152c05e60, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.701938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.715187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1222/2443] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:15 2021] PUT /identity/v3/projects/ff0c51a9efd1409793b0e21a4094ee8a/users/6479ed56336a497eaa40d7e152c05e60/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:15.719102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.729467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111b24d-3daf-4202-a284-0082994fa654 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.782979 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f22747-2fd2-41b4-8920-56cc4c2c05b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.783663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22747-2fd2-41b4-8920-56cc4c2c05b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.783947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22747-2fd2-41b4-8920-56cc4c2c05b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.784858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22747-2fd2-41b4-8920-56cc4c2c05b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.785592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22747-2fd2-41b4-8920-56cc4c2c05b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.787498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22747-2fd2-41b4-8920-56cc4c2c05b3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.801227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1222/2444] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:15.802413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.813097 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ea1f-8ddf-4f42-b4b0-b9672a340867 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:15.817796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:15.818669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.818949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.819252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] PATH_INFO: `/v3/projects/ff0c51a9efd1409793b0e21a4094ee8a/users/6479ed56336a497eaa40d7e152c05e60/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.821639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c51a9efd1409793b0e21a4094ee8a, user_id=6479ed56336a497eaa40d7e152c05e60, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:15.824733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:15.837973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1223/2445] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:15 2021] PUT /identity/v3/projects/ff0c51a9efd1409793b0e21a4094ee8a/users/6479ed56336a497eaa40d7e152c05e60/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:15.848803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:15.849089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:15.849362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:15.879768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] MFA Rules not processed for user `6479ed56336a497eaa40d7e152c05e60`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:15.880968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:15.947924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1223/2446] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:15 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:15.958650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:15.960375 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:16.016034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1b83-5563-4b5b-a3f9-4bcfc59ff314 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:16.019979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:16.020605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:16.020889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:16.021165 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:16.029846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:16.031293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:16.040922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1224/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:15 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:16.111751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:16.123174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55615dd-f977-4f17-9c59-8989a7a64ebd None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:16.127162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85a4e2-d2b7-497f-a429-a0025e78400a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:16.127976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85a4e2-d2b7-497f-a429-a0025e78400a service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:16.128269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85a4e2-d2b7-497f-a429-a0025e78400a service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:16.128545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85a4e2-d2b7-497f-a429-a0025e78400a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:16.191868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85a4e2-d2b7-497f-a429-a0025e78400a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:16.193511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85a4e2-d2b7-497f-a429-a0025e78400a service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:16.207479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1224/2448] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:16 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:27.323162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:27.388378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7905c1-0fb5-4b67-8004-16385e0bb50d service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:27.393412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:27.394305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:27.394612 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:27.394913 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] PATH_INFO: `/v3/users/177898658c5a46b5aeddd3cf1320b74e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:27.396852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177898658c5a46b5aeddd3cf1320b74e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:27.398801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:27.446317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177898658c5a46b5aeddd3cf1320b74e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:27.452904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177898658c5a46b5aeddd3cf1320b74e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:27.453568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177898658c5a46b5aeddd3cf1320b74e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:27.465791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177898658c5a46b5aeddd3cf1320b74e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:27.472659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177898658c5a46b5aeddd3cf1320b74e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:27.478652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1225/2449] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:27 2021] DELETE /identity/v3/users/177898658c5a46b5aeddd3cf1320b74e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:27.483262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:27.484564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:27.484880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:27.503165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:27.504355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:27.560577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1225/2450] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:27.571211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:27.572582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:27.629038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15360-892d-4d16-9df2-4b2129dd9e00 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:27.633333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:27.633964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:27.634245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:27.634519 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:27.643319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:27.644738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:27.654084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1226/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:27.974798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:27.976265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:27.988617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467160f-fddc-42f6-b0e7-a644edd88062 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:27.993916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:27.994874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:27.995775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:27.995775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] PATH_INFO: `/v3/projects/b24f5590f7f94bdca6848a5e109242f9` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:27.996861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24f5590f7f94bdca6848a5e109242f9)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:27.998769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.044948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24f5590f7f94bdca6848a5e109242f9', 'request_id': 'req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.051003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24f5590f7f94bdca6848a5e109242f9', 'request_id': 'req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.058921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24f5590f7f94bdca6848a5e109242f9', 'request_id': 'req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.068953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] The token cache is being invalidate because project b24f5590f7f94bdca6848a5e109242f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:28.069243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.069888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.071458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1226/2452] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:27 2021] DELETE /identity/v3/projects/b24f5590f7f94bdca6848a5e109242f9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:28.075394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.085400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1724de0-7162-4ec6-8c22-dfbf28d4795d service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.140000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:28.140859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.141143 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.141417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] PATH_INFO: `/v3/users/6479ed56336a497eaa40d7e152c05e60` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.142647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6479ed56336a497eaa40d7e152c05e60)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:28.144606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.190022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6479ed56336a497eaa40d7e152c05e60'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.196604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6479ed56336a497eaa40d7e152c05e60'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.197269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6479ed56336a497eaa40d7e152c05e60'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.209283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6479ed56336a497eaa40d7e152c05e60'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.216603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-35d05a86-1acc-4c14-af77-41922ac4e5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6479ed56336a497eaa40d7e152c05e60'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.222538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1227/2453] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:28 2021] DELETE /identity/v3/users/6479ed56336a497eaa40d7e152c05e60 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:28.488260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.490461 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:28.504660 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055bcb6-85c0-4f1c-9b0e-060e28dfc989 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.568123 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:28.568971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.569246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.569512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] PATH_INFO: `/v3/projects/ff0c51a9efd1409793b0e21a4094ee8a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.570686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0c51a9efd1409793b0e21a4094ee8a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:28.572610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.619702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0c51a9efd1409793b0e21a4094ee8a', 'request_id': 'req-c008e8cc-a273-4bfb-8738-f1de1c946c78'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.625952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0c51a9efd1409793b0e21a4094ee8a', 'request_id': 'req-c008e8cc-a273-4bfb-8738-f1de1c946c78'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.633117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0c51a9efd1409793b0e21a4094ee8a', 'request_id': 'req-c008e8cc-a273-4bfb-8738-f1de1c946c78'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.643101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] The token cache is being invalidate because project ff0c51a9efd1409793b0e21a4094ee8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:28.643388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.644028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c008e8cc-a273-4bfb-8738-f1de1c946c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:28.645557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1227/2454] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:28 2021] DELETE /identity/v3/projects/ff0c51a9efd1409793b0e21a4094ee8a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:28.651226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.651713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.651953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.671161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:28.672365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:28.731181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1228/2455] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:28.739127 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.739419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.739698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.758425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:28.759663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:28.767643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1228/2456] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:28.771657 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.781731 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f47f6-8247-4f85-b507-119116a24e86 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.786401 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:28.787584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.787864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.788136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.788859 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:28.789163 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:28.790741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.802333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1229/2457] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:20:28.807239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.816675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac3fd-4129-447c-874d-801d6e654fad None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.821484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:28.822131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.822414 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.822691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.823448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:28.825504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.851208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1229/2458] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:28 2021] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:28.855321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.865994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09d9d-5d81-441a-8b9c-f9ff203a6b8a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.920624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:28.921358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.921561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.921809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.922509 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:28.924443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.946299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1230/2459] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:28 2021] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:28.950508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.961335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fa4d-e302-4d63-b7c4-8d31fdd17c9c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.966002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:28.966658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:28.966943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:28.967249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:28.967982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:28.969582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:28.980078 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1230/2460] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:20:28.984137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:28.994661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78270e-df99-4892-be87-2e766d4ae7fd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:28.999398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4cfa2-9471-4477-b424-699e999620ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.000055 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4cfa2-9471-4477-b424-699e999620ae admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.000343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4cfa2-9471-4477-b424-699e999620ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.000618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4cfa2-9471-4477-b424-699e999620ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.001370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4cfa2-9471-4477-b424-699e999620ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.002949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4cfa2-9471-4477-b424-699e999620ae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.016870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1231/2461] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:20:29.018128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.028488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf367c-27c0-4c00-988e-6ddc21a6ab68 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.033404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.034310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.034589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.034863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] PATH_INFO: `/v3/projects/baef1db6fd0748f6b4f7fc08a9c1769d/users/ce7069309e244e3db009253fc027ec6a/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.050058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=baef1db6fd0748f6b4f7fc08a9c1769d, user_id=ce7069309e244e3db009253fc027ec6a, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.054530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.069825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1231/2462] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:29 2021] PUT /identity/v3/projects/baef1db6fd0748f6b4f7fc08a9c1769d/users/ce7069309e244e3db009253fc027ec6a/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:29.081093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.081512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.081998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.108459 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] MFA Rules not processed for user `ce7069309e244e3db009253fc027ec6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:29.109668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:29.174086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1232/2463] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:29 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:29.179357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.240861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b72f7-0af3-41cb-aab5-21a62df5c6af admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.245336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.245970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.246247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.246537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.247243 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.249126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.273720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1232/2464] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:29 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:29.278445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.289809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e72ee-d0f7-4e01-a758-7c8a8b5e5c00 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.342746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.343434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.343713 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.343985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.344808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.346737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.367724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1233/2465] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:29 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:29.371666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.382233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d47e8-9a99-4afd-be03-1e4534699edf admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.386976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.387656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.387939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.388215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.388981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.390683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.403433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1233/2466] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:29.405481 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.415447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b1ce-bf70-4f82-8ebf-d020aa2eda07 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.420342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee286e-e28a-46bd-9294-3dbeb62570ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.421001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee286e-e28a-46bd-9294-3dbeb62570ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.421289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee286e-e28a-46bd-9294-3dbeb62570ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.421565 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee286e-e28a-46bd-9294-3dbeb62570ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.422297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee286e-e28a-46bd-9294-3dbeb62570ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.423921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee286e-e28a-46bd-9294-3dbeb62570ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.434110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1234/2467] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:29.438213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.448680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5b138-82be-4fb7-b7e8-6aabae32cf1b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.453467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.454360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.454639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.454912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] PATH_INFO: `/v3/projects/b759260069d74f6dbcca9a61d0979500/users/e2c7311477f24dc584fedf622d4b610f/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.470101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b759260069d74f6dbcca9a61d0979500, user_id=e2c7311477f24dc584fedf622d4b610f, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.472784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.485047 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1234/2468] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:29 2021] PUT /identity/v3/projects/b759260069d74f6dbcca9a61d0979500/users/e2c7311477f24dc584fedf622d4b610f/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:29.495537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.495764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.496056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.523711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] MFA Rules not processed for user `e2c7311477f24dc584fedf622d4b610f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:29.525188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:29.589919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1235/2469] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:29 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:29.594382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.656016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2d19-d204-4857-ac02-d4a72e40cf9f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.661203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.661870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.662850 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.663273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.663973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.665879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.691674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1235/2470] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:29 2021] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:29.695755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.706371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ad3-d77f-4199-b138-f8392cce442d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.763102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.763681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.763967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.764264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.764970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.766876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.789717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1236/2471] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:29 2021] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:29.791594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.802027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5154-2e86-4701-a29f-c09ff2537d7c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.806702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.807396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.807683 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.807963 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.808721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.810335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.820307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1236/2472] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:29.824625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.834905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996d51-9c99-4ab1-b6f6-cafb7e1e1f47 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.839506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.840382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.840660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.840928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] PATH_INFO: `/v3/projects/1d1fe3aef6354bb9a24f3981c09ce114/users/1a175a0acbdf42ce9daeba8c5bae2f67/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.855725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1fe3aef6354bb9a24f3981c09ce114, user_id=1a175a0acbdf42ce9daeba8c5bae2f67, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.858325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.871860 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1237/2473] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:29 2021] PUT /identity/v3/projects/1d1fe3aef6354bb9a24f3981c09ce114/users/1a175a0acbdf42ce9daeba8c5bae2f67/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:29.875796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.886208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3757d1-de05-4333-a8d7-4d4c1de7219e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.940052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e06e45-0ce2-4c52-80f3-de60274b02c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.940712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e06e45-0ce2-4c52-80f3-de60274b02c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.940997 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e06e45-0ce2-4c52-80f3-de60274b02c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.941274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e06e45-0ce2-4c52-80f3-de60274b02c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.942010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e06e45-0ce2-4c52-80f3-de60274b02c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.944258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e06e45-0ce2-4c52-80f3-de60274b02c3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.954076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1237/2474] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:29.958047 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:29.968588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1aba-8a49-4777-b798-20be8e7cc362 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:29.973378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:29.974244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:29.974520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:29.974790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] PATH_INFO: `/v3/projects/1d1fe3aef6354bb9a24f3981c09ce114/users/1a175a0acbdf42ce9daeba8c5bae2f67/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:29.976769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1fe3aef6354bb9a24f3981c09ce114, user_id=1a175a0acbdf42ce9daeba8c5bae2f67, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:29.979403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:29.989870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1238/2475] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:29 2021] PUT /identity/v3/projects/1d1fe3aef6354bb9a24f3981c09ce114/users/1a175a0acbdf42ce9daeba8c5bae2f67/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:30.002685 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:30.002978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:30.003284 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:30.029591 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] MFA Rules not processed for user `1a175a0acbdf42ce9daeba8c5bae2f67`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:30.030727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:30.096815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1238/2476] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:30 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:30.107119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:30.109014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:30.165529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761a59d-4758-4402-b819-3723e73da6dc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:30.172236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:30.172890 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:30.173168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:30.173463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:30.183740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:30.185190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:30.194942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1239/2477] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:30 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:30.642665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:30.652612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02361e8-65f8-4e30-a108-34c40112d3f6 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:30.656430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:30.657101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:30.657386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:30.657663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:30.713989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:30.715466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:30.724309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1239/2478] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:30 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:34.645718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:34.654178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45bde-75d8-42df-9cac-9f6f7937fb21 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:34.657892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076572-050d-478b-bcb4-91c6be98689e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:34.658478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076572-050d-478b-bcb4-91c6be98689e service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:34.658756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076572-050d-478b-bcb4-91c6be98689e service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:34.659027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076572-050d-478b-bcb4-91c6be98689e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:34.714489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076572-050d-478b-bcb4-91c6be98689e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:34.715842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076572-050d-478b-bcb4-91c6be98689e service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:34.724300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1240/2479] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:34 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:36.768135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:36.828302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db4bd0-d94b-4059-85dd-697705415d60 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:36.832839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:36.833684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:36.833964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:36.834240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] PATH_INFO: `/v3/users/ce7069309e244e3db009253fc027ec6a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:36.835455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7069309e244e3db009253fc027ec6a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:36.837352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:36.885798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7069309e244e3db009253fc027ec6a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:36.886736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7069309e244e3db009253fc027ec6a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:36.898716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7069309e244e3db009253fc027ec6a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:36.899456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7069309e244e3db009253fc027ec6a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:36.906689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7069309e244e3db009253fc027ec6a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:36.919106 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1240/2480] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:36 2021] DELETE /identity/v3/users/ce7069309e244e3db009253fc027ec6a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:36.923689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:36.924179 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:36.924279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:36.942907 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:36.944146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:36.999923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1241/2481] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:37.012560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:37.013988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:37.069427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dd2b4-9872-4757-b10b-bc49098c39ed admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:37.073120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:37.073755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:37.074044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:37.074317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:37.083226 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:37.084652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:37.093751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1241/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:37.440878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:37.442474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:37.459021 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976cba5-fb7d-4a21-ba72-3a6d4e3855f0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:37.464555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:37.465405 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:37.466144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:37.466144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] PATH_INFO: `/v3/projects/baef1db6fd0748f6b4f7fc08a9c1769d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:37.467265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baef1db6fd0748f6b4f7fc08a9c1769d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:37.469282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:37.515935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baef1db6fd0748f6b4f7fc08a9c1769d', 'request_id': 'req-94c7490e-2882-4020-a1aa-c589fc515ed9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.521830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baef1db6fd0748f6b4f7fc08a9c1769d', 'request_id': 'req-94c7490e-2882-4020-a1aa-c589fc515ed9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.531812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baef1db6fd0748f6b4f7fc08a9c1769d', 'request_id': 'req-94c7490e-2882-4020-a1aa-c589fc515ed9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.544113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] The token cache is being invalidate because project baef1db6fd0748f6b4f7fc08a9c1769d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:37.544402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.545069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.546651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1242/2483] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:37 2021] DELETE /identity/v3/projects/baef1db6fd0748f6b4f7fc08a9c1769d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:37.550625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:37.560754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5911cf-383b-4948-9eed-b3969b5f2203 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:37.616179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:37.617749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:37.617918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:37.618114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] PATH_INFO: `/v3/users/e2c7311477f24dc584fedf622d4b610f` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:37.619334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c7311477f24dc584fedf622d4b610f)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:37.621233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:37.666701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c7311477f24dc584fedf622d4b610f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.667465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c7311477f24dc584fedf622d4b610f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.680110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c7311477f24dc584fedf622d4b610f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.680781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c7311477f24dc584fedf622d4b610f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.688279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c7311477f24dc584fedf622d4b610f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:37.701475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1242/2484] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:37 2021] DELETE /identity/v3/users/e2c7311477f24dc584fedf622d4b610f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:37.989180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:37.990625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.006409 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7490e-2882-4020-a1aa-c589fc515ed9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:38.075188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:38.076040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.076322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.076590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] PATH_INFO: `/v3/projects/b759260069d74f6dbcca9a61d0979500` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.077782 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b759260069d74f6dbcca9a61d0979500)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:38.079702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:38.128444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b759260069d74f6dbcca9a61d0979500', 'request_id': 'req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.135118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b759260069d74f6dbcca9a61d0979500', 'request_id': 'req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.141899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b759260069d74f6dbcca9a61d0979500', 'request_id': 'req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.154869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] The token cache is being invalidate because project b759260069d74f6dbcca9a61d0979500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:38.155182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.155813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.157344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1243/2485] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:37 2021] DELETE /identity/v3/projects/b759260069d74f6dbcca9a61d0979500 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:38.161410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:38.162867 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.175255 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722231b-1bea-4645-8dbf-03111d3cc49e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:38.234723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:38.235518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.235801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.236077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] PATH_INFO: `/v3/users/1a175a0acbdf42ce9daeba8c5bae2f67` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.237269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a175a0acbdf42ce9daeba8c5bae2f67)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:38.239613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:38.289215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a175a0acbdf42ce9daeba8c5bae2f67'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.289863 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a175a0acbdf42ce9daeba8c5bae2f67'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.301337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a175a0acbdf42ce9daeba8c5bae2f67'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.301968 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a175a0acbdf42ce9daeba8c5bae2f67'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.309355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a175a0acbdf42ce9daeba8c5bae2f67'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.320855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1243/2486] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:38 2021] DELETE /identity/v3/users/1a175a0acbdf42ce9daeba8c5bae2f67 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:38.594873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:38.596420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.610500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b926c9-a0e3-416c-bfb4-3726bc9b7712 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:38.669557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:38.670407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.670691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.670967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] PATH_INFO: `/v3/projects/1d1fe3aef6354bb9a24f3981c09ce114` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.672196 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1fe3aef6354bb9a24f3981c09ce114)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:38.674199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:38.702253 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:38.703819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.722600 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1fe3aef6354bb9a24f3981c09ce114', 'request_id': 'req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.729374 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1fe3aef6354bb9a24f3981c09ce114', 'request_id': 'req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.736673 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1fe3aef6354bb9a24f3981c09ce114', 'request_id': 'req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.747298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] The token cache is being invalidate because project 1d1fe3aef6354bb9a24f3981c09ce114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:38.747581 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.748254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4b5f6f0f-b94b-4eaf-b203-3e0a849c9465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:38.749995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1244/2487] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:38 2021] DELETE /identity/v3/projects/1d1fe3aef6354bb9a24f3981c09ce114 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:38.758250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e48f4-db79-4830-8435-e7ae82f8238b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.758527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e48f4-db79-4830-8435-e7ae82f8238b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.758796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e48f4-db79-4830-8435-e7ae82f8238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.776525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b83e48f4-db79-4830-8435-e7ae82f8238b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:38.777631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b83e48f4-db79-4830-8435-e7ae82f8238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.778938 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969690ab-c595-40e5-8259-016e2a02a644 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:38.837345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1245/2488] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:38.845791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.846273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:38.846521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.846611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.846915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.847229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.847502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.849224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.864979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:38.866168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:38.873931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1246/2489] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:20:38.878017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:38.886681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f208149-87f8-4d10-9181-e882f46fc222 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:38.892634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:38.893296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.893743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.894020 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.894750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:20:38.895067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:38.896669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:38.909031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:38.909203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1247/2490] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:20:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:20:38.910559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:38.913737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:38.920328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1244/2491] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:38 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:38.923889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55ee8-0b66-4d9b-9d87-9f9feba66d5c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:38.928530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:38.929166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:38.929455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:38.929733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:38.930464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:38.932368 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:38.958974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1248/2492] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:38 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:38.967624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:38.978876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c038d18-393f-4342-b441-12c0ba18308d service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.036605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.037194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.037480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.037753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.039094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.041035 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.067483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1245/2493] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:38 2021] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:39.068655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.080655 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c22134-be1f-47f6-8283-b77ccd1c0260 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.086058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.086794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.087169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.087487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.088312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.089894 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.100247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1249/2494] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:39.104611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.115071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ecb2-f3dd-444d-9de8-3a683e784afc admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.122496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17455e-b980-4564-912d-103a9561743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.123191 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17455e-b980-4564-912d-103a9561743e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.123474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17455e-b980-4564-912d-103a9561743e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.123751 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17455e-b980-4564-912d-103a9561743e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.124495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17455e-b980-4564-912d-103a9561743e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.126087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17455e-b980-4564-912d-103a9561743e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.139142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1246/2495] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:39 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:39.143668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.158654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fcd05-9784-43bd-80f8-b86ee69fe0a8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.164079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.164954 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.165216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.165568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] PATH_INFO: `/v3/projects/5145ff6dce6e43068f06bc80e96bfab2/users/3dd43b02d51c4f93b2b1dbdd0dd363ee/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.180659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5145ff6dce6e43068f06bc80e96bfab2, user_id=3dd43b02d51c4f93b2b1dbdd0dd363ee, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.183275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.195815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1250/2496] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:39 2021] PUT /identity/v3/projects/5145ff6dce6e43068f06bc80e96bfab2/users/3dd43b02d51c4f93b2b1dbdd0dd363ee/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:39.206579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.207155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.207155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.233044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] MFA Rules not processed for user `3dd43b02d51c4f93b2b1dbdd0dd363ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:39.234229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:39.299432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1247/2497] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:39.304466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.363562 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b3d7-d674-4ffc-b306-05741481e481 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.369789 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.370438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.370735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.370990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.371711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.373601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.399272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1251/2498] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:39 2021] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:20:39.403238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.414094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763289a-2d90-4919-92cd-bf31b98e7871 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.469330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.469989 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.470265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.470535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.471266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.473175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.493439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1248/2499] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:39 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:39.497805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.508321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f411-6abc-4927-a030-0f6a8ca267f8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.512934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.513608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.513886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.514159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.514880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.516529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.527320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1252/2500] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:20:39.531257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.541473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ec7-9926-45b8-80b6-fa40651959cb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.546009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572561d-81db-4958-84c1-45d8bb62505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.546643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572561d-81db-4958-84c1-45d8bb62505e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.546919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572561d-81db-4958-84c1-45d8bb62505e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.547228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572561d-81db-4958-84c1-45d8bb62505e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.547948 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572561d-81db-4958-84c1-45d8bb62505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.549574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572561d-81db-4958-84c1-45d8bb62505e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.559451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1249/2501] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:39.563384 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.572987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8071866-2785-40ec-a161-9eb262125f1c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.577660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.578525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.578809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.579117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] PATH_INFO: `/v3/projects/c304d1c1cffc4cd2b2b7ca9c7481f946/users/31020f1bbbfe4d8190c26c0a0ab889cb/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.595331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c304d1c1cffc4cd2b2b7ca9c7481f946, user_id=31020f1bbbfe4d8190c26c0a0ab889cb, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.597986 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.611467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1253/2502] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:39 2021] PUT /identity/v3/projects/c304d1c1cffc4cd2b2b7ca9c7481f946/users/31020f1bbbfe4d8190c26c0a0ab889cb/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:39.622834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.623164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.623443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.650066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] MFA Rules not processed for user `31020f1bbbfe4d8190c26c0a0ab889cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:39.651361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:39.721196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1250/2503] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:39.726639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.791310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02448df3-5382-43f5-b8a6-9c99cfe913fc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.799365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.800225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.800492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.800832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.801598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.804059 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.831639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1254/2504] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:20:39 2021] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:39.839341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.850006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483dd16-8913-471b-89a8-6d43143aacdc None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.907105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.907763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.908041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.908311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.909020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.911014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.929206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1251/2505] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:20:39 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:20:39.933260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.943164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4db2-76cf-45c9-b938-c189f3d9aff2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.948251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.948885 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.949160 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.949432 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:39.950150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:39.951749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:39.966027 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1255/2506] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:39.967249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:39.979350 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3265-28c6-440b-8f7c-2dfbbd3014a4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:39.984711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:39.985595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:39.985875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:39.986147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] PATH_INFO: `/v3/projects/09bee1a1729b474990858b78e2e5240b/users/cac26033f4fc4557b1d11e817cbbc91b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:40.001545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bee1a1729b474990858b78e2e5240b, user_id=cac26033f4fc4557b1d11e817cbbc91b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:40.004218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:40.017841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1252/2507] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:39 2021] PUT /identity/v3/projects/09bee1a1729b474990858b78e2e5240b/users/cac26033f4fc4557b1d11e817cbbc91b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:40.021853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:40.032208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56e299-42e5-4be6-b88f-1da07ff628c1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:40.089565 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748bcd1-76e4-45d6-868b-e4e4d815884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:40.090261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748bcd1-76e4-45d6-868b-e4e4d815884e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:40.090495 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748bcd1-76e4-45d6-868b-e4e4d815884e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:40.090767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748bcd1-76e4-45d6-868b-e4e4d815884e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:40.091528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748bcd1-76e4-45d6-868b-e4e4d815884e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:40.093153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748bcd1-76e4-45d6-868b-e4e4d815884e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:40.103152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1256/2508] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:20:40 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:20:40.107307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:40.117921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ea88-8ec5-4dde-826b-34c6c7ea25f1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:40.122443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:40.123346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:40.123624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:40.123893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] PATH_INFO: `/v3/projects/09bee1a1729b474990858b78e2e5240b/users/cac26033f4fc4557b1d11e817cbbc91b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:40.125928 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bee1a1729b474990858b78e2e5240b, user_id=cac26033f4fc4557b1d11e817cbbc91b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:40.128553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:40.139165 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1253/2509] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:20:40 2021] PUT /identity/v3/projects/09bee1a1729b474990858b78e2e5240b/users/cac26033f4fc4557b1d11e817cbbc91b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:40.149649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:40.149930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:40.150202 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:40.175552 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] MFA Rules not processed for user `cac26033f4fc4557b1d11e817cbbc91b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:40.176743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:40.242366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1257/2510] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:40 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:40.253130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:40.254937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:40.310112 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaca48a-1cd1-42e7-afac-7d5a6d75853a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:40.313682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:40.314310 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:40.314589 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:40.314866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:40.370067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:40.371534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:40.380162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1254/2511] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:40 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:42.893935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:42.895402 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:42.907718 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c918c3-d2e5-49ee-ba44-0ab1431b2bf2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:42.911288 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:42.911916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:42.912199 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:42.912476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:42.967107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:42.969579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:42.977305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1258/2512] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:42 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:43.473973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:43.482260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c9f88-df7e-44f5-a53e-95e28c7d2fe5 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:43.486071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08257444-8f1d-48b5-90f4-837973ad8c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:43.486704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257444-8f1d-48b5-90f4-837973ad8c26 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:43.486987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257444-8f1d-48b5-90f4-837973ad8c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:43.487311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257444-8f1d-48b5-90f4-837973ad8c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:43.496982 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08257444-8f1d-48b5-90f4-837973ad8c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:43.498365 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08257444-8f1d-48b5-90f4-837973ad8c26 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:43.508343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1255/2513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:43 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:48.342482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:48.404121 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc077f2-df2d-4b31-9b6c-7445fef04346 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:48.408704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:48.409556 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:48.409837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:48.410107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] PATH_INFO: `/v3/users/3dd43b02d51c4f93b2b1dbdd0dd363ee` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:48.411343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd43b02d51c4f93b2b1dbdd0dd363ee)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:48.413472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:48.457341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd43b02d51c4f93b2b1dbdd0dd363ee'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:48.463827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd43b02d51c4f93b2b1dbdd0dd363ee'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:48.464482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd43b02d51c4f93b2b1dbdd0dd363ee'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:48.475814 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd43b02d51c4f93b2b1dbdd0dd363ee'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:48.483543 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd43b02d51c4f93b2b1dbdd0dd363ee'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:48.490200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1259/2514] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:48 2021] DELETE /identity/v3/users/3dd43b02d51c4f93b2b1dbdd0dd363ee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:48.495138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:48.495579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:48.495774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:48.513485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:20:48.514664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:48.572565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1256/2515] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:20:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:20:48.582190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:48.583606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:48.639797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62fac8-5c0d-460c-a665-43ad06ee50de admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:48.643542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:48.644261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:48.644776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:48.645156 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:48.654420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:48.655898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:48.666011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1260/2516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:20:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:20:48.916817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:48.918358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:48.930676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9c96-37a1-493f-87cd-574c8b27f63b None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:48.936048 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:48.936900 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:48.937229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:48.937509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] PATH_INFO: `/v3/projects/5145ff6dce6e43068f06bc80e96bfab2` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:48.938686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5145ff6dce6e43068f06bc80e96bfab2)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:48.940638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:48.985085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5145ff6dce6e43068f06bc80e96bfab2', 'request_id': 'req-364e9c86-53ff-410e-976a-1ce1fb853afe'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:48.994782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5145ff6dce6e43068f06bc80e96bfab2', 'request_id': 'req-364e9c86-53ff-410e-976a-1ce1fb853afe'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.002199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5145ff6dce6e43068f06bc80e96bfab2', 'request_id': 'req-364e9c86-53ff-410e-976a-1ce1fb853afe'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.012230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] The token cache is being invalidate because project 5145ff6dce6e43068f06bc80e96bfab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:49.012529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.013175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.014707 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1257/2517] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:48 2021] DELETE /identity/v3/projects/5145ff6dce6e43068f06bc80e96bfab2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:49.018686 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:49.028197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de744d-5709-4b71-bed6-12a63abca74d service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:49.082430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:49.083307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:49.083584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:49.083855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] PATH_INFO: `/v3/users/31020f1bbbfe4d8190c26c0a0ab889cb` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:49.085025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31020f1bbbfe4d8190c26c0a0ab889cb)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:49.086917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:49.129975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31020f1bbbfe4d8190c26c0a0ab889cb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.136614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31020f1bbbfe4d8190c26c0a0ab889cb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.137273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31020f1bbbfe4d8190c26c0a0ab889cb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.148582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31020f1bbbfe4d8190c26c0a0ab889cb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.155453 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31020f1bbbfe4d8190c26c0a0ab889cb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.161220 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1261/2518] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:49 2021] DELETE /identity/v3/users/31020f1bbbfe4d8190c26c0a0ab889cb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:49.419519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:49.421206 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:49.435164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e9c86-53ff-410e-976a-1ce1fb853afe admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:49.495246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:49.496093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:49.496379 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:49.496657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] PATH_INFO: `/v3/projects/c304d1c1cffc4cd2b2b7ca9c7481f946` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:49.497841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c304d1c1cffc4cd2b2b7ca9c7481f946)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:49.499793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:49.544079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c304d1c1cffc4cd2b2b7ca9c7481f946', 'request_id': 'req-2fb14aed-582b-4008-8a62-622060221718'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.549888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c304d1c1cffc4cd2b2b7ca9c7481f946', 'request_id': 'req-2fb14aed-582b-4008-8a62-622060221718'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.556940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c304d1c1cffc4cd2b2b7ca9c7481f946', 'request_id': 'req-2fb14aed-582b-4008-8a62-622060221718'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.566972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] The token cache is being invalidate because project c304d1c1cffc4cd2b2b7ca9c7481f946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:49.567285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.567937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.569983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1258/2519] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:49 2021] DELETE /identity/v3/projects/c304d1c1cffc4cd2b2b7ca9c7481f946 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:20:49.573870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:49.575431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:49.588498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1a32-f3be-4c41-af89-443777237a24 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:49.641261 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:49.642109 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:49.642387 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:49.642654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] PATH_INFO: `/v3/users/cac26033f4fc4557b1d11e817cbbc91b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:49.643851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac26033f4fc4557b1d11e817cbbc91b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:49.645766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:49.699265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac26033f4fc4557b1d11e817cbbc91b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.705999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac26033f4fc4557b1d11e817cbbc91b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.706672 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac26033f4fc4557b1d11e817cbbc91b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.719411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac26033f4fc4557b1d11e817cbbc91b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.726606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-e39c3af5-a683-428b-948b-f6636954c924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac26033f4fc4557b1d11e817cbbc91b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:49.732465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1262/2520] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:20:49 2021] DELETE /identity/v3/users/cac26033f4fc4557b1d11e817cbbc91b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:20:49.994844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:20:49.996328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:20:50.011234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14aed-582b-4008-8a62-622060221718 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:20:50.066329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:20:50.067202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:20:50.067485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:20:50.067784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] PATH_INFO: `/v3/projects/09bee1a1729b474990858b78e2e5240b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:20:50.068966 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bee1a1729b474990858b78e2e5240b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:20:50.071552 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:20:50.115434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bee1a1729b474990858b78e2e5240b', 'request_id': 'req-f673caf9-1456-483c-81c7-4b28e64768c9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:50.121951 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bee1a1729b474990858b78e2e5240b', 'request_id': 'req-f673caf9-1456-483c-81c7-4b28e64768c9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:50.129272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bee1a1729b474990858b78e2e5240b', 'request_id': 'req-f673caf9-1456-483c-81c7-4b28e64768c9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:50.139804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] The token cache is being invalidate because project 09bee1a1729b474990858b78e2e5240b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:20:50.140085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:50.140699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f673caf9-1456-483c-81c7-4b28e64768c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:20:50.142195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1259/2521] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:20:49 2021] DELETE /identity/v3/projects/09bee1a1729b474990858b78e2e5240b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:21:37.147099 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:21:37.147623 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:21:37.147738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:21:37.164917 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] MFA Rules not processed for user `e9bfec4b3f8b47cf93f7d07703365d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:21:37.166118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:21:37.218992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1263/2522] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:21:37 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:21:56.853548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:21:56.854125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:21:56.854125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:21:56.871537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] MFA Rules not processed for user `0a4d52d1d56e44fe97650262ca2e68df`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:21:56.872721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:21:56.924491 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1260/2523] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:21:56 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:18.633765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:18.635345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:18.717922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176b76-ae79-41eb-bb08-5844048e7134 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:18.723308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:18.724066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:18.724350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:18.724625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:18.726497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:18.739218 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:18.740802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd79602-fa08-41ed-9fea-975d47b585f1 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:18.751136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1264/2524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:22:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:22:25.406474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:25.408028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:25.424326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f672e-bbe5-4f06-abd8-fdcbd6867b16 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:25.430244 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:25.430868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:25.431187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:25.431465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:25.433254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:25.489304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:25.491558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:25.500646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1261/2525] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:22:25 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:22:32.877957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe52cb-e1bc-464d-a352-5b8c822c9a4c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:32.878498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe52cb-e1bc-464d-a352-5b8c822c9a4c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:32.878498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe52cb-e1bc-464d-a352-5b8c822c9a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:32.895998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e2fe52cb-e1bc-464d-a352-5b8c822c9a4c None None] MFA Rules not processed for user `107444106cda461dab7c403665d92613`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:32.897197 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e2fe52cb-e1bc-464d-a352-5b8c822c9a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:32.952911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1265/2526] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:22:32 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:33.331893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:33.333301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:33.386342 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799fdce-e719-4fb6-972a-44afe03579d3 service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:33.389889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:33.390506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:33.390782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:33.391069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:33.392791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:33.402880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:33.404328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:33.411897 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1262/2527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:22:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:22:38.967791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:38.968275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:38.968365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:38.987228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:38.988527 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:39.059872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1266/2528] 10.222.0.43 () {58 vars in 967 bytes} [Tue Dec 14 03:22:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:39.113752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:39.115860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:39.185302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d05f3-ad6e-4617-ba7f-754f92def375 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:39.190533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:39.191209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:39.191492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:39.191767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:39.200129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:39.201701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:39.209620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1263/2529] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:22:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:22:39.572634 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:39.574026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:39.585616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f15a47-cb76-499a-a498-d4e462a71954 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:39.589158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:39.589784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:39.590061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:39.590328 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:39.592017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:39.651914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:39.653311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:39.663336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1267/2530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:22:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:22:45.435434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:45.437111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:45.457259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179d32c-9437-4464-a19e-dc986edce148 service swift] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:45.463272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:45.464131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:45.464405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:45.464840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] PATH_INFO: `/v3/users/e9bfec4b3f8b47cf93f7d07703365d1a` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:45.466239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bfec4b3f8b47cf93f7d07703365d1a)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:45.468250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:45.518147 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bfec4b3f8b47cf93f7d07703365d1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.518832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bfec4b3f8b47cf93f7d07703365d1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.531156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bfec4b3f8b47cf93f7d07703365d1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.531834 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bfec4b3f8b47cf93f7d07703365d1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.540640 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bfec4b3f8b47cf93f7d07703365d1a'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.552836 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1264/2531] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:22:45 2021] DELETE /identity/v3/users/e9bfec4b3f8b47cf93f7d07703365d1a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:45.731577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:45.747074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702aca4-f1ee-4ec0-a99a-9b1f58264c8c service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:45.824388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:45.826406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:45.826791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:45.827273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] PATH_INFO: `/v3/projects/325c78a0c8574ce0bb38f768705a1181` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:45.828730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325c78a0c8574ce0bb38f768705a1181)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:45.830866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:45.881378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325c78a0c8574ce0bb38f768705a1181', 'request_id': 'req-7abd76f5-cd30-4b10-b7d2-94140a677b95'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.887987 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325c78a0c8574ce0bb38f768705a1181', 'request_id': 'req-7abd76f5-cd30-4b10-b7d2-94140a677b95'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.899473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325c78a0c8574ce0bb38f768705a1181', 'request_id': 'req-7abd76f5-cd30-4b10-b7d2-94140a677b95'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.912276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] The token cache is being invalidate because project 325c78a0c8574ce0bb38f768705a1181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:22:45.912689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.913369 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:45.915297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1268/2532] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:22:45 2021] DELETE /identity/v3/projects/325c78a0c8574ce0bb38f768705a1181 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:46.581010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:46.582608 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:46.600102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fccfc-a7cd-4ca1-a940-a448ce7c527a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:46.662750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:46.663768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:46.664058 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:46.664337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] PATH_INFO: `/v3/users/f1d620fa9da54f588f753b3c497f00c7` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:46.665567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d620fa9da54f588f753b3c497f00c7)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:46.667568 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:46.715362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d620fa9da54f588f753b3c497f00c7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:46.716036 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d620fa9da54f588f753b3c497f00c7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:46.728283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d620fa9da54f588f753b3c497f00c7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:46.728926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d620fa9da54f588f753b3c497f00c7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:46.741507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d620fa9da54f588f753b3c497f00c7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:46.753816 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1265/2533] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:22:46 2021] DELETE /identity/v3/users/f1d620fa9da54f588f753b3c497f00c7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:46.916398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:46.917876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:46.930679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd76f5-cd30-4b10-b7d2-94140a677b95 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:46.985636 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:46.986478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:46.986760 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:46.987061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] PATH_INFO: `/v3/projects/bc2e5ee76edf4e358f418773bf824ed7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:46.988514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2e5ee76edf4e358f418773bf824ed7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:46.990437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.035240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2e5ee76edf4e358f418773bf824ed7', 'request_id': 'req-8ccb5407-2eeb-4d87-b968-8a5e9541af67'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.041926 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2e5ee76edf4e358f418773bf824ed7', 'request_id': 'req-8ccb5407-2eeb-4d87-b968-8a5e9541af67'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.048437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2e5ee76edf4e358f418773bf824ed7', 'request_id': 'req-8ccb5407-2eeb-4d87-b968-8a5e9541af67'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.058597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] The token cache is being invalidate because project bc2e5ee76edf4e358f418773bf824ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:22:47.058884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.059546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.061074 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1269/2534] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:22:46 2021] DELETE /identity/v3/projects/bc2e5ee76edf4e358f418773bf824ed7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:47.065156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.066565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:47.079209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9318-26ee-411c-9ebc-bef2b1a0cc49 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:47.134092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:47.134956 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.135276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.135554 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] PATH_INFO: `/v3/users/1754713b43f34d238d6503887a5e2e14` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.136740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1754713b43f34d238d6503887a5e2e14)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:47.138657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.182260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1754713b43f34d238d6503887a5e2e14'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.182837 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1754713b43f34d238d6503887a5e2e14'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.194525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1754713b43f34d238d6503887a5e2e14'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.195183 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1754713b43f34d238d6503887a5e2e14'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.202111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-42be46ba-d5a7-4316-be31-70fb1cc8f51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1754713b43f34d238d6503887a5e2e14'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.214433 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1266/2535] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:22:47 2021] DELETE /identity/v3/users/1754713b43f34d238d6503887a5e2e14 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:47.448922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.450502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:47.466771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5407-2eeb-4d87-b968-8a5e9541af67 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:47.534026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:47.535264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.535393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.535734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] PATH_INFO: `/v3/projects/574a0ff076ae428999f919b34df1c6c8` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.537192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=574a0ff076ae428999f919b34df1c6c8)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:47.539012 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.594522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574a0ff076ae428999f919b34df1c6c8', 'request_id': 'req-6dba6033-20f6-4c3b-812c-561ab6b53bbb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.600659 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574a0ff076ae428999f919b34df1c6c8', 'request_id': 'req-6dba6033-20f6-4c3b-812c-561ab6b53bbb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.608520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574a0ff076ae428999f919b34df1c6c8', 'request_id': 'req-6dba6033-20f6-4c3b-812c-561ab6b53bbb'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.620660 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] The token cache is being invalidate because project 574a0ff076ae428999f919b34df1c6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:22:47.620957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.621727 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6dba6033-20f6-4c3b-812c-561ab6b53bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:22:47.623373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1270/2536] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:22:47 2021] DELETE /identity/v3/projects/574a0ff076ae428999f919b34df1c6c8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:47.629107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.629601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.629697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.649729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:47.651309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:47.713774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1267/2537] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:22:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:47.721919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.722206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.722486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.744271 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:47.745743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:47.754573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1271/2538] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:22:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:47.759225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.769235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466d2a3-36f3-401f-98cf-922b3d56b561 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:47.774198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:47.774869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.775233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.775509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.776252 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:22:47.776558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:47.778387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.794312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1268/2539] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:22:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:22:47.795750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.805615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bac3b-721d-42f0-9f25-4c0fcc4881d7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:47.810309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:47.810966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.811277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.811553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.812262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:47.814152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.854364 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1272/2540] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:22:47 2021] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:22:47.855712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.866738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f29a6-fd88-4ef6-8b75-eb876620e059 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:47.922117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:47.922915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.923242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.923497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.924201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:47.926122 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.951382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1269/2541] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:22:47 2021] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:22:47.952560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.962773 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4adb05-1909-46cb-97d5-ce9cc3ab27ac admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:47.967551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:47.968147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:47.968430 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:47.968705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:47.969438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:47.971092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:47.981498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1273/2542] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:22:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:22:47.985483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:47.996254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e98d8-9940-4738-b3c7-f51b28f88c59 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:48.000876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d13f1e-6d95-4aca-a115-0db31e185dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:48.001511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d13f1e-6d95-4aca-a115-0db31e185dae admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:48.001790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d13f1e-6d95-4aca-a115-0db31e185dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:48.002056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d13f1e-6d95-4aca-a115-0db31e185dae admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:48.002786 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d13f1e-6d95-4aca-a115-0db31e185dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:48.004396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d13f1e-6d95-4aca-a115-0db31e185dae admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:48.014208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1270/2543] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:22:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:22:48.018322 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:48.028175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5fdb-a4cc-4b2b-b16c-792318747c2f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:48.032821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:48.033685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:48.034462 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:48.034962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] PATH_INFO: `/v3/projects/d0c4dcf4957d42b896f04f682afeef7b/users/bf869873369f496e9e25a6d6b2a7ba86/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:48.050093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c4dcf4957d42b896f04f682afeef7b, user_id=bf869873369f496e9e25a6d6b2a7ba86, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:48.053339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:48.066269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1274/2544] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:22:48 2021] PUT /identity/v3/projects/d0c4dcf4957d42b896f04f682afeef7b/users/bf869873369f496e9e25a6d6b2a7ba86/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:22:48.072056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61548-b312-421e-b8d6-0a379ba1aa79 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:48.072368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61548-b312-421e-b8d6-0a379ba1aa79 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:48.072652 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61548-b312-421e-b8d6-0a379ba1aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:48.090976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-21f61548-b312-421e-b8d6-0a379ba1aa79 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:48.092205 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-21f61548-b312-421e-b8d6-0a379ba1aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:48.157636 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1271/2545] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:22:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:48.166947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:48.168799 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:48.224589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e199fd3-ee88-4eab-ba6c-c476aaf788a1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:48.229029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:48.229464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:48.229618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:48.229895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:48.239831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:48.241302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:48.250942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1275/2546] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:22:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:22:52.401484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.402074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.402074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.429159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] MFA Rules not processed for user `bf869873369f496e9e25a6d6b2a7ba86`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:52.430366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:52.498381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1272/2547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:22:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:52.503003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:52.513345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d3747-1dd4-47e1-ab87-24c990401b07 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:52.518039 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:52.519056 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.519597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.519828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.520522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:52.523024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:52.550067 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1276/2548] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:22:52 2021] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:22:52.554354 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:52.568316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95602a-713c-4e73-a429-9ea5bce03efe None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:52.652631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:52.653579 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.654513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.655263 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.656215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:52.658240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:52.684223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1273/2549] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:22:52 2021] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:22:52.687966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:52.699959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221403d3-f573-44e2-9349-38785056c34e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:52.704876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:52.705533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.706008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.706280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.707223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:52.709411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:52.736752 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1277/2550] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:22:52 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:22:52.741750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:52.766425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a5aa5-875d-45e6-93d9-451740930024 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:52.777167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:52.778287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.778732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.779194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] PATH_INFO: `/v3/projects/0474e738524046fc9da3b998a6133a0d/users/2382b3eb96834b978f018c0bbbc61b5c/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.793903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=0474e738524046fc9da3b998a6133a0d, user_id=2382b3eb96834b978f018c0bbbc61b5c, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:52.796601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:52.820072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1274/2551] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:22:52 2021] PUT /identity/v3/projects/0474e738524046fc9da3b998a6133a0d/users/2382b3eb96834b978f018c0bbbc61b5c/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:52.824054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:52.835489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb782a-47ab-4360-a4b5-289f99c8043a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:52.896665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67dcbd-2239-4525-abbf-9c804d548180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:52.897334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67dcbd-2239-4525-abbf-9c804d548180 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.897616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67dcbd-2239-4525-abbf-9c804d548180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.897891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67dcbd-2239-4525-abbf-9c804d548180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.898622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67dcbd-2239-4525-abbf-9c804d548180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:52.900272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67dcbd-2239-4525-abbf-9c804d548180 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:52.910467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1278/2552] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:22:52 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:22:52.914522 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:52.925073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233752-5bc6-47b2-a1f5-1173e7a94fde admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:52.930603 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:52.931525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:52.931810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:52.932086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] PATH_INFO: `/v3/projects/0474e738524046fc9da3b998a6133a0d/users/2382b3eb96834b978f018c0bbbc61b5c/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:52.934126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0474e738524046fc9da3b998a6133a0d, user_id=2382b3eb96834b978f018c0bbbc61b5c, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:52.936862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:52.948409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1275/2553] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:22:52 2021] PUT /identity/v3/projects/0474e738524046fc9da3b998a6133a0d/users/2382b3eb96834b978f018c0bbbc61b5c/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:22:57.373272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9095720-1f5a-4c36-88b0-6c4ee7776451 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:57.373780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9095720-1f5a-4c36-88b0-6c4ee7776451 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:57.373893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9095720-1f5a-4c36-88b0-6c4ee7776451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:57.400576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c9095720-1f5a-4c36-88b0-6c4ee7776451 None None] MFA Rules not processed for user `2382b3eb96834b978f018c0bbbc61b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:22:57.401805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c9095720-1f5a-4c36-88b0-6c4ee7776451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:57.473026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1279/2554] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:22:57 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:22:57.480728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:22:57.482409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:22:57.556101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472f48-1ffa-4cbf-825e-abc787aa76c0 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:22:57.561664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:22:57.562302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:22:57.562586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:22:57.562890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:22:57.628516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:22:57.630701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:22:57.641029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1276/2555] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:22:57 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:23:24.374524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1269b-fc43-4458-be25-41821897b76f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:23:24.375071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1269b-fc43-4458-be25-41821897b76f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:23:24.375071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1269b-fc43-4458-be25-41821897b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:23:24.392260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-86a1269b-fc43-4458-be25-41821897b76f None None] MFA Rules not processed for user `bf869873369f496e9e25a6d6b2a7ba86`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:23:24.393480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-86a1269b-fc43-4458-be25-41821897b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:23:24.402148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1280/2556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:23:24 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:23:25.779472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:23:25.780911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:23:25.848422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467ae7-c6f7-457e-a062-1fa5cf3c8a43 service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:23:25.853421 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:23:25.854049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:23:25.854328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:23:25.854601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:23:25.856403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:23:25.868610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:23:25.870179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0588-ad2c-4c85-95ba-a93c1f40e56a service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:23:25.880316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1277/2557] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:23:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:23:41.836871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1269b-fc43-4458-be25-41821897b76f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:23:41.889790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1269b-fc43-4458-be25-41821897b76f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:23:41.893249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:23:41.893869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:23:41.894215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:23:41.894483 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:23:41.903993 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:23:41.905395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:23:41.914528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1281/2558] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:23:41 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:24:03.373247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d3e7-d59e-45b4-bde0-7d981553d275 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:03.373804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d3e7-d59e-45b4-bde0-7d981553d275 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:03.373804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d3e7-d59e-45b4-bde0-7d981553d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:03.391258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b7f8d3e7-d59e-45b4-bde0-7d981553d275 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:24:03.392456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b7f8d3e7-d59e-45b4-bde0-7d981553d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:03.447303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1278/2559] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:24:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:24:03.493393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:24:03.494941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:03.560386 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b28518-49d7-445c-8a9c-66174f6fbef5 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:24:03.566038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:24:03.566915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:03.567064 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:03.567258 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:03.576234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:24:03.577794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:24:03.585787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1282/2560] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:24:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:24:20.464006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:20.464493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:20.464605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:20.481827 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:24:20.482943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:20.490675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1279/2561] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:24:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:24:20.502930 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:24:20.513476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddbb90-f107-4f16-a53c-586027ee79ab service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:24:20.518394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:24:20.519006 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:20.519327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:20.519582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:20.527688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:24:20.529240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:24:20.537036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1283/2562] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:24:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 14 03:24:31.765646 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:24:31.775675 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab8c7f-c142-4f6e-8933-fee07552d24d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:24:31.779305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:24:31.779937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:31.780221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:31.780496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:31.782265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:31.795934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:24:31.797358 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3a02-b51d-497e-8410-ed46b1fe8354 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:24:31.808529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1280/2563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:24:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:24:35.324485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:24:35.333528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd565d-2a43-489f-84c9-ca3f2a6be2c6 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:24:35.337076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:24:35.337684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:35.337959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:35.338227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:35.339967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:35.353213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:24:35.354597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:24:35.365980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1284/2564] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:24:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:24:43.242352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:43.242791 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:43.242910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:43.260776 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:24:43.262017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:43.269063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1281/2565] 10.222.0.43 () {58 vars in 967 bytes} [Tue Dec 14 03:24:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:24:43.281750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:24:43.293854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce97fe6-e1da-4467-b1e5-cb0142561f5c service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:24:43.298785 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:24:43.299437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:43.299715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:43.299985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:43.308590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:24:43.310146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:24:43.317931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1285/2566] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:24:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:24:59.192190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:24:59.193593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:59.205265 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb099bc5-1237-41f1-a184-a7faec27a6ce None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:24:59.208854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:24:59.209475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:24:59.209755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:24:59.210068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:24:59.212280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:24:59.271444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:24:59.273483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:24:59.282749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1282/2567] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:24:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:02.412967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:02.414998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:02.428444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e4d64-08e1-470f-99b0-77ff91094fb2 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:02.433136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:02.434038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:02.434320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:02.434597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] PATH_INFO: `/v3/users/107444106cda461dab7c403665d92613` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:02.448305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107444106cda461dab7c403665d92613)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:02.450211 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:02.494835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107444106cda461dab7c403665d92613'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.501382 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107444106cda461dab7c403665d92613'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.502046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107444106cda461dab7c403665d92613'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.513383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107444106cda461dab7c403665d92613'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.520546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-94c5b024-1783-4ea7-a98f-1b6fc681fda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107444106cda461dab7c403665d92613'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.526763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1286/2568] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:02 2021] DELETE /identity/v3/users/107444106cda461dab7c403665d92613 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:02.703671 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:02.720208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b982f-d832-4bd6-a2c9-abab3b2c9e57 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:02.784973 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:02.785826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:02.786111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:02.786385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] PATH_INFO: `/v3/projects/11634c00674445cb81d9dabfbcc791a8` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:02.797391 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11634c00674445cb81d9dabfbcc791a8)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:02.799368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:02.845249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11634c00674445cb81d9dabfbcc791a8', 'request_id': 'req-5d526350-b883-4cad-99ef-e7f5efe91749'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.851667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11634c00674445cb81d9dabfbcc791a8', 'request_id': 'req-5d526350-b883-4cad-99ef-e7f5efe91749'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.865634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11634c00674445cb81d9dabfbcc791a8', 'request_id': 'req-5d526350-b883-4cad-99ef-e7f5efe91749'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.876569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] The token cache is being invalidate because project 11634c00674445cb81d9dabfbcc791a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:02.876855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.877500 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5d526350-b883-4cad-99ef-e7f5efe91749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:02.879144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1283/2569] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:02 2021] DELETE /identity/v3/projects/11634c00674445cb81d9dabfbcc791a8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:02.885378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:02.885663 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:02.885938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:02.905318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:02.906548 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:02.961703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1287/2570] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:02.969578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c624f-481d-4aae-8527-2608ef0983db None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:02.969865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c624f-481d-4aae-8527-2608ef0983db None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:02.970142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c624f-481d-4aae-8527-2608ef0983db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:02.988379 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-963c624f-481d-4aae-8527-2608ef0983db None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:02.989582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-963c624f-481d-4aae-8527-2608ef0983db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:02.997423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1284/2571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:03.001395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.011093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9078e-05fd-473a-91cf-d10734a08186 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.015530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.016161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.016436 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.016705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.017424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:25:03.017726 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.019310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.030849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1288/2572] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:25:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:25:03.035052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c624f-481d-4aae-8527-2608ef0983db None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.044137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c624f-481d-4aae-8527-2608ef0983db None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.048849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.049513 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.049797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.050070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.050763 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.052690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.078443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1285/2573] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:03 2021] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:03.082497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.093004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a933-a898-4465-9b8f-970831989dfe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.146185 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.146828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.147144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.148046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.148745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.150648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.170584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1289/2574] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:03 2021] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:25:03.174634 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.185292 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1940f-cf97-4cf2-bef0-8ff867fc6096 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.189809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.190447 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.190726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.190996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.191756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.193318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.204888 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1286/2575] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:03.212815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.222407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4079e10-612b-4d73-9595-a538e1a5032e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.227065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718749-af45-4d52-b149-fcbc25097068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.227717 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718749-af45-4d52-b149-fcbc25097068 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.227999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718749-af45-4d52-b149-fcbc25097068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.228273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718749-af45-4d52-b149-fcbc25097068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.228995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718749-af45-4d52-b149-fcbc25097068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.230557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718749-af45-4d52-b149-fcbc25097068 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.240319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1290/2576] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:03.244784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.254580 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20453471-b9da-4a2f-b0f4-ee6591b73ab1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.259696 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.260545 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.260822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.261096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] PATH_INFO: `/v3/projects/feb579fd6dde4869a7ad55192522ecd9/users/ee8dd74cdf7e45bea2853064250b5fb2/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.275167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb579fd6dde4869a7ad55192522ecd9, user_id=ee8dd74cdf7e45bea2853064250b5fb2, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.277774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.290021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1287/2577] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:03 2021] PUT /identity/v3/projects/feb579fd6dde4869a7ad55192522ecd9/users/ee8dd74cdf7e45bea2853064250b5fb2/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:25:03.299735 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.300023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.300299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.326411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] MFA Rules not processed for user `ee8dd74cdf7e45bea2853064250b5fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:03.327635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:03.388702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1291/2578] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:03 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:03.393049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.452362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b5697-9c66-4bf9-b01c-83e3f491bc51 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.457240 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.457885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.458164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.458464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.459201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.461137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.484796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1288/2579] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:03 2021] POST /identity/v3/projects => generated 403 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:03.488998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.499875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e509-0b53-41d7-8fef-0cf66cf44b23 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.553419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.554584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.554865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.555168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.555867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.557754 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.576489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1292/2580] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:03 2021] POST /identity/v3/users => generated 308 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:03.580509 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.590429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f3962-b238-4e6e-8c9d-c12bfe91ef97 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.594986 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.595657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.595937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.596215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.596935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.598519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.609312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1289/2581] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:03.613247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.623319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9cdf-0292-4250-91e2-654e62b1bb1b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.627871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.628719 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.628994 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.629259 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] PATH_INFO: `/v3/projects/a20c08a5dfe146e18bb44cd6837eb8c1/users/e5556167678b46d18845c2418de01468/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.643252 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20c08a5dfe146e18bb44cd6837eb8c1, user_id=e5556167678b46d18845c2418de01468, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.645846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.658295 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1293/2582] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:03 2021] PUT /identity/v3/projects/a20c08a5dfe146e18bb44cd6837eb8c1/users/e5556167678b46d18845c2418de01468/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:03.662239 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.673531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873e5be-a918-4e4c-a0cd-59f734b86376 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.727231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e9ef7-7536-4802-b4c4-c7a27e472836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.727854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9ef7-7536-4802-b4c4-c7a27e472836 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.728143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9ef7-7536-4802-b4c4-c7a27e472836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.728416 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9ef7-7536-4802-b4c4-c7a27e472836 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.729132 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e9ef7-7536-4802-b4c4-c7a27e472836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.730716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e9ef7-7536-4802-b4c4-c7a27e472836 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.740419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1290/2583] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:25:03.745041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.755023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a9f4-1b91-48b8-8c6a-7b67900fc289 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.759604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.760464 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.760743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.761093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] PATH_INFO: `/v3/projects/a20c08a5dfe146e18bb44cd6837eb8c1/users/e5556167678b46d18845c2418de01468/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.762985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20c08a5dfe146e18bb44cd6837eb8c1, user_id=e5556167678b46d18845c2418de01468, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.765601 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.775541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1294/2584] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:03 2021] PUT /identity/v3/projects/a20c08a5dfe146e18bb44cd6837eb8c1/users/e5556167678b46d18845c2418de01468/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:03.785620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.785950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.786280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.812476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] MFA Rules not processed for user `e5556167678b46d18845c2418de01468`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:03.813666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:03.878052 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1291/2585] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:03 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:03.888033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:03.889729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:03.946041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226bfdc-09ed-4d25-9a13-531d9f6320a0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:03.949632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705d467-3eb2-46fa-8f69-47c1a784a8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:03.950262 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d467-3eb2-46fa-8f69-47c1a784a8fd service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:03.950537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d467-3eb2-46fa-8f69-47c1a784a8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:03.950804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d467-3eb2-46fa-8f69-47c1a784a8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:03.959349 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705d467-3eb2-46fa-8f69-47c1a784a8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:03.961268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705d467-3eb2-46fa-8f69-47c1a784a8fd service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:03.970251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1295/2586] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:03 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:04.103300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:04.167172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9d11-7534-4d16-bda4-71b0fedf61c8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:04.171605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:04.172446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:04.172724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:04.172996 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] PATH_INFO: `/v3/users/ee8dd74cdf7e45bea2853064250b5fb2` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:04.174182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8dd74cdf7e45bea2853064250b5fb2)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:04.176137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:04.219597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8dd74cdf7e45bea2853064250b5fb2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.220299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8dd74cdf7e45bea2853064250b5fb2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.231813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8dd74cdf7e45bea2853064250b5fb2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.232430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8dd74cdf7e45bea2853064250b5fb2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.239385 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8dd74cdf7e45bea2853064250b5fb2'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.251398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1292/2587] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:04 2021] DELETE /identity/v3/users/ee8dd74cdf7e45bea2853064250b5fb2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:04.255796 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:04.256076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:04.256345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:04.274134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:04.275400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:04.332628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1296/2588] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:04.342417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:04.343874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:04.399950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce0e16-e953-4b3c-bdc2-fb910d1097fa admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:04.403593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:04.404217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:04.404498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:04.404855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:04.414656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:04.416116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:04.425241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1293/2589] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:04.672953 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:04.674650 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:04.689560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97bea0-5f0f-46ea-89b6-1ac23e1ca25e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:04.694250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:04.695236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:04.695578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:04.696357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] PATH_INFO: `/v3/projects/feb579fd6dde4869a7ad55192522ecd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:04.697746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb579fd6dde4869a7ad55192522ecd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:04.699736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:04.744427 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb579fd6dde4869a7ad55192522ecd9', 'request_id': 'req-cf390434-de26-4938-a742-b51cbb684cf2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.750302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb579fd6dde4869a7ad55192522ecd9', 'request_id': 'req-cf390434-de26-4938-a742-b51cbb684cf2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.757348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb579fd6dde4869a7ad55192522ecd9', 'request_id': 'req-cf390434-de26-4938-a742-b51cbb684cf2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.767592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] The token cache is being invalidate because project feb579fd6dde4869a7ad55192522ecd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:04.767825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.768450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.769961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1297/2590] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:04 2021] DELETE /identity/v3/projects/feb579fd6dde4869a7ad55192522ecd9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:04.774600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:04.784988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de66237-a6d8-4025-82e5-edace717e62d service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:04.837517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:04.838362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:04.838639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:04.838910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] PATH_INFO: `/v3/users/e5556167678b46d18845c2418de01468` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:04.840104 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5556167678b46d18845c2418de01468)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:04.842022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:04.884376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5556167678b46d18845c2418de01468'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.885008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5556167678b46d18845c2418de01468'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.895998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5556167678b46d18845c2418de01468'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.896613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5556167678b46d18845c2418de01468'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.904043 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-34b96bb6-81b5-4efa-8965-e127c3c826bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5556167678b46d18845c2418de01468'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:04.916260 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1294/2591] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:04 2021] DELETE /identity/v3/users/e5556167678b46d18845c2418de01468 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:05.173260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.174824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:05.188191 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390434-de26-4938-a742-b51cbb684cf2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.243626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.244467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.244746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.245050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] PATH_INFO: `/v3/projects/a20c08a5dfe146e18bb44cd6837eb8c1` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.246215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20c08a5dfe146e18bb44cd6837eb8c1)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.248114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.292336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20c08a5dfe146e18bb44cd6837eb8c1', 'request_id': 'req-2d399cde-1c6d-4299-9ea8-5c6ef4454171'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:05.298148 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20c08a5dfe146e18bb44cd6837eb8c1', 'request_id': 'req-2d399cde-1c6d-4299-9ea8-5c6ef4454171'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:05.304265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20c08a5dfe146e18bb44cd6837eb8c1', 'request_id': 'req-2d399cde-1c6d-4299-9ea8-5c6ef4454171'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:05.313809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] The token cache is being invalidate because project a20c08a5dfe146e18bb44cd6837eb8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:05.314084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:05.314702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2d399cde-1c6d-4299-9ea8-5c6ef4454171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:05.316222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1298/2592] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:05 2021] DELETE /identity/v3/projects/a20c08a5dfe146e18bb44cd6837eb8c1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:05.322572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.322854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.323146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.341462 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:05.342656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:05.399259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1295/2593] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:05.408978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.409385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.409821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.427946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:05.429654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:05.437668 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1299/2594] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:25:05.441890 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.451999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca79f4-2861-4f6c-88b3-92c1f5d92759 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.456588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.457221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.457504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.457780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.458506 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:25:05.458809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.460427 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.471567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1296/2595] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:25:05.475805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.484820 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54a37a-cd06-4bce-981d-ed960d62d894 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.489764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.490398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.490681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.491473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.492198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.494068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.518632 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1300/2596] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:05 2021] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:05.522534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.532163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f298eb-af9f-4ee8-b8bf-27b6b60ec910 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.584372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.585011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.585306 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.585560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.586236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.588159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.606662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1297/2597] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:05 2021] POST /identity/v3/users => generated 303 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:05.610688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.621376 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20777d58-0e09-47f9-abd6-0a41beb3876a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.626029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.626670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.626975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.627291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.628048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.629648 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.640491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1301/2598] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:05.644033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.654282 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4c14-152d-4834-8f2f-b5f6da041173 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.658929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25125b88-bc81-4114-a55d-10141b0fa60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.659604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125b88-bc81-4114-a55d-10141b0fa60b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.659903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125b88-bc81-4114-a55d-10141b0fa60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.660641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125b88-bc81-4114-a55d-10141b0fa60b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.660875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25125b88-bc81-4114-a55d-10141b0fa60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.662456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25125b88-bc81-4114-a55d-10141b0fa60b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.672606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1298/2599] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:05.676438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.686649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43f50-b8e3-4c10-a769-a0b2a648a6df admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.691279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.692137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.692588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.692705 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] PATH_INFO: `/v3/projects/cb592fad72af4d73aea8f53b672220da/users/12821a0612f344ac8b183a2e515f4fb4/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.707404 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb592fad72af4d73aea8f53b672220da, user_id=12821a0612f344ac8b183a2e515f4fb4, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.710049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.722198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1302/2600] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:05 2021] PUT /identity/v3/projects/cb592fad72af4d73aea8f53b672220da/users/12821a0612f344ac8b183a2e515f4fb4/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:05.727196 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba348e1b-6317-4714-99aa-8fcfffd8a925 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.727489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba348e1b-6317-4714-99aa-8fcfffd8a925 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.727772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba348e1b-6317-4714-99aa-8fcfffd8a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.745609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ba348e1b-6317-4714-99aa-8fcfffd8a925 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:05.746787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ba348e1b-6317-4714-99aa-8fcfffd8a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:05.802336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1299/2601] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:05.812625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:05.814357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:05.869377 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d926db0-5dce-45cc-b0d8-30a1339c5d87 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:05.873083 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:05.873721 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:05.874031 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:05.874304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:05.883240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:05.884738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:05.893798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1303/2602] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:06.470975 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.471322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.471587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.499267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] MFA Rules not processed for user `12821a0612f344ac8b183a2e515f4fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:06.500556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:06.563934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1300/2603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:06 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:06.568546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:06.578508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21211d-e68f-492f-8918-f5ab39b50f5a service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:06.583168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:06.583878 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.584225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.584568 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.585933 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:06.587918 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:06.616411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1304/2604] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:06 2021] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:06.617564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:06.629512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07ba5-0b7b-4763-81cf-57150781d37d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:06.686023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:06.686611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.686893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.687197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.687905 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:06.689812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:06.708958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1301/2605] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:06 2021] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:06.713644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:06.723697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f0d9d-ab32-439e-89f7-741ebee7ab1c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:06.728770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:06.729407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.729688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.729962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.730685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:06.732290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:06.743309 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1305/2606] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:06.747203 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:06.756787 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eba8a4-1f56-40db-97da-0123101a925c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:06.761347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:06.762199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.762478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.762785 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] PATH_INFO: `/v3/projects/46fa4d088fd44cddac22eadcfbe3cbf5/users/0f7dc381e1bd433896408c7023d3379b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.776819 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fa4d088fd44cddac22eadcfbe3cbf5, user_id=0f7dc381e1bd433896408c7023d3379b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:06.779976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:06.793739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1302/2607] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:06 2021] PUT /identity/v3/projects/46fa4d088fd44cddac22eadcfbe3cbf5/users/0f7dc381e1bd433896408c7023d3379b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:25:06.796975 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:06.807434 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cd3e4-597d-4913-aa05-a92f5ca912e0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:06.861534 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d6f9c-ba25-44e0-add4-9723825b8722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:06.862458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d6f9c-ba25-44e0-add4-9723825b8722 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.862740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d6f9c-ba25-44e0-add4-9723825b8722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.863032 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d6f9c-ba25-44e0-add4-9723825b8722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.863776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d6f9c-ba25-44e0-add4-9723825b8722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:06.865359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d6f9c-ba25-44e0-add4-9723825b8722 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:06.875354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1306/2608] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:06 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:06.879527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:06.889704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298ece-b112-4924-8e41-4e15e1fcbaec admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:06.894225 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:06.895114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:06.895395 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:06.895667 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] PATH_INFO: `/v3/projects/46fa4d088fd44cddac22eadcfbe3cbf5/users/0f7dc381e1bd433896408c7023d3379b/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:06.898108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fa4d088fd44cddac22eadcfbe3cbf5, user_id=0f7dc381e1bd433896408c7023d3379b, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:06.900795 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:06.910621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1303/2609] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:06 2021] PUT /identity/v3/projects/46fa4d088fd44cddac22eadcfbe3cbf5/users/0f7dc381e1bd433896408c7023d3379b/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:07.491398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:07.491706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:07.491978 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:07.518555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] MFA Rules not processed for user `0f7dc381e1bd433896408c7023d3379b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:07.519809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:07.589235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1307/2610] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:07 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:08.546436 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:08.607643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef90bc1-c5a4-43ff-ad38-b63d83c02577 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:08.612489 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:08.613329 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:08.613606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:08.613875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] PATH_INFO: `/v3/users/12821a0612f344ac8b183a2e515f4fb4` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:08.615034 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12821a0612f344ac8b183a2e515f4fb4)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:08.616967 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:08.660093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12821a0612f344ac8b183a2e515f4fb4'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.660856 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12821a0612f344ac8b183a2e515f4fb4'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.672803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12821a0612f344ac8b183a2e515f4fb4'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.673455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12821a0612f344ac8b183a2e515f4fb4'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.681641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12821a0612f344ac8b183a2e515f4fb4'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.693697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1304/2611] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:08 2021] DELETE /identity/v3/users/12821a0612f344ac8b183a2e515f4fb4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:25:08.862903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:08.873505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc341af-c29e-411e-8399-599dc6c65b05 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:08.928569 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:08.929450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:08.929728 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:08.930002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] PATH_INFO: `/v3/projects/cb592fad72af4d73aea8f53b672220da` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:08.931200 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb592fad72af4d73aea8f53b672220da)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:08.933075 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:08.976815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb592fad72af4d73aea8f53b672220da', 'request_id': 'req-54d394ee-666e-421a-8f4e-3deb771516fe'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.982628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb592fad72af4d73aea8f53b672220da', 'request_id': 'req-54d394ee-666e-421a-8f4e-3deb771516fe'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.989557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb592fad72af4d73aea8f53b672220da', 'request_id': 'req-54d394ee-666e-421a-8f4e-3deb771516fe'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:08.999183 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] The token cache is being invalidate because project cb592fad72af4d73aea8f53b672220da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:08.999465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.000072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.001693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1308/2612] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:08 2021] DELETE /identity/v3/projects/cb592fad72af4d73aea8f53b672220da => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:09.005593 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.007526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:09.019862 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308f044-ad2a-4be9-85a6-cdde419eba9b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.073011 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.073857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.074133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.074397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] PATH_INFO: `/v3/users/0f7dc381e1bd433896408c7023d3379b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.075598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7dc381e1bd433896408c7023d3379b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.077486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.120092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7dc381e1bd433896408c7023d3379b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.120717 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7dc381e1bd433896408c7023d3379b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.132572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7dc381e1bd433896408c7023d3379b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.133201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7dc381e1bd433896408c7023d3379b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.140396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7455ba7a-1716-49a0-8b99-0f83c2c2309d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7dc381e1bd433896408c7023d3379b'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.152720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1305/2613] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:09 2021] DELETE /identity/v3/users/0f7dc381e1bd433896408c7023d3379b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:09.315004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.316449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:09.329745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d394ee-666e-421a-8f4e-3deb771516fe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.385221 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.386063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.386343 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.386617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] PATH_INFO: `/v3/projects/46fa4d088fd44cddac22eadcfbe3cbf5` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.387835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fa4d088fd44cddac22eadcfbe3cbf5)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.389703 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.434865 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fa4d088fd44cddac22eadcfbe3cbf5', 'request_id': 'req-d828c2b2-a614-442b-9c84-14245713173c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.440822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fa4d088fd44cddac22eadcfbe3cbf5', 'request_id': 'req-d828c2b2-a614-442b-9c84-14245713173c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.448256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fa4d088fd44cddac22eadcfbe3cbf5', 'request_id': 'req-d828c2b2-a614-442b-9c84-14245713173c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.458052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] The token cache is being invalidate because project 46fa4d088fd44cddac22eadcfbe3cbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:09.458330 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.458938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d828c2b2-a614-442b-9c84-14245713173c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:09.461480 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1309/2614] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:09 2021] DELETE /identity/v3/projects/46fa4d088fd44cddac22eadcfbe3cbf5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:09.467233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105345e0-91df-42d7-af51-f907673cb720 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.467518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105345e0-91df-42d7-af51-f907673cb720 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.467788 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105345e0-91df-42d7-af51-f907673cb720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.485364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-105345e0-91df-42d7-af51-f907673cb720 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:09.486648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-105345e0-91df-42d7-af51-f907673cb720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:09.545783 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1306/2615] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:09.555137 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.555426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.555722 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.573553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:09.574824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:09.582511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1310/2616] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:09.586475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105345e0-91df-42d7-af51-f907673cb720 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.595879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105345e0-91df-42d7-af51-f907673cb720 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.600914 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.601544 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.601821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.602090 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.602808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:25:09.603143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.604712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.616601 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1307/2617] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:25:09.620725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.629415 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bde24a-4bf9-4e5c-ab02-0c5baa139ce9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.633983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.634604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.634879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.635190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.635889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.637736 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.661484 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1311/2618] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:09 2021] POST /identity/v3/projects => generated 373 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:09.666177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.676126 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e7b6e-1f3e-4ff0-8648-50377229773b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.729606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.730246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.730523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.730794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.731523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.733417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.752312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1308/2619] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:09 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:09.756339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.766194 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ffd03-a45b-4a9f-b695-cd0b9183e451 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.770740 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.771416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.771698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.771973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.772697 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.774268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.785816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1312/2620] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:09.790022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.799874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bedf1a-fd8a-46b2-8c96-77f805ba4b83 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.805089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c5a43-3572-4fa1-9f42-e6c2bfa308bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.805727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c5a43-3572-4fa1-9f42-e6c2bfa308bb admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.806024 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c5a43-3572-4fa1-9f42-e6c2bfa308bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.806279 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c5a43-3572-4fa1-9f42-e6c2bfa308bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.807002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c5a43-3572-4fa1-9f42-e6c2bfa308bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.808618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c5a43-3572-4fa1-9f42-e6c2bfa308bb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.818401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1309/2621] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:09.822340 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:09.832049 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968aab-0501-423e-b2ee-1a94738f617e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:09.836691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:09.837549 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.837831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.838108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] PATH_INFO: `/v3/projects/8375ed2b4aac4c9b9683c5cbcededb21/users/f381009b6e624ee7be8ae75d2bfe642c/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.852724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8375ed2b4aac4c9b9683c5cbcededb21, user_id=f381009b6e624ee7be8ae75d2bfe642c, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:09.855366 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:09.869054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1313/2622] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:09 2021] PUT /identity/v3/projects/8375ed2b4aac4c9b9683c5cbcededb21/users/f381009b6e624ee7be8ae75d2bfe642c/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:09.879360 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:09.879655 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:09.879931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:09.905689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] MFA Rules not processed for user `f381009b6e624ee7be8ae75d2bfe642c`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:09.906912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:09.966561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1310/2623] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:09.970911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.028846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757073b8-d56e-406c-b96b-f123acaeb71f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.033411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.034073 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.034354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.034625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.035357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.037231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.061244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1314/2624] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:09 2021] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:10.065300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.075695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adde4b4-6b51-4b28-932d-705defd3e989 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.130293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.130874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.131194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.132117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.132853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.134815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.153804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1311/2625] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:10 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:25:10.157862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.168034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b4a1d-2d3d-4409-b7f3-1f29414cbdac admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.172674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.173317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.173597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.173869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.174616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.176248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.187344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1315/2626] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:10.191424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.201876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03de08-af1c-4883-adb8-2c2747b3b24b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.206425 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.207336 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.207610 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.207881 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] PATH_INFO: `/v3/projects/30986e7ea7ed4be7b25f4f4596ac813b/users/a1b72134779942c3888728bdfb381a19/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.222007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30986e7ea7ed4be7b25f4f4596ac813b, user_id=a1b72134779942c3888728bdfb381a19, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.224691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.236910 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1312/2627] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:10 2021] PUT /identity/v3/projects/30986e7ea7ed4be7b25f4f4596ac813b/users/a1b72134779942c3888728bdfb381a19/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:10.241624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.251485 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ccbe7-d8b4-4cbb-a0f2-4fe092ea231b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.306114 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d04cc-3004-4dbe-8eeb-bc5809a072e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.306768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d04cc-3004-4dbe-8eeb-bc5809a072e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.307065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d04cc-3004-4dbe-8eeb-bc5809a072e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.307359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d04cc-3004-4dbe-8eeb-bc5809a072e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.308084 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d04cc-3004-4dbe-8eeb-bc5809a072e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.309698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d04cc-3004-4dbe-8eeb-bc5809a072e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.319180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1316/2628] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:10 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:10.323173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.333204 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d7db-93e4-4749-a25b-3d3fcdddbed8 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.337804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.338662 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.338942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.339322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] PATH_INFO: `/v3/projects/30986e7ea7ed4be7b25f4f4596ac813b/users/a1b72134779942c3888728bdfb381a19/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.341291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30986e7ea7ed4be7b25f4f4596ac813b, user_id=a1b72134779942c3888728bdfb381a19, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.343930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.354355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1313/2629] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:10 2021] PUT /identity/v3/projects/30986e7ea7ed4be7b25f4f4596ac813b/users/a1b72134779942c3888728bdfb381a19/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:10.365419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.365706 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.366588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.391780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] MFA Rules not processed for user `a1b72134779942c3888728bdfb381a19`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:10.393178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:10.459091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1317/2630] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:10 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:10.469324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.471086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:10.529766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12fa2-f9ac-4d7d-858e-c772c6f2ef25 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.533483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.534115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.534398 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.534674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.543945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.545349 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.555072 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1314/2631] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:10 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:10.624805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:10.634256 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8f289-c5c4-430a-b570-bc2d60a5f1cb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:10.637903 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:10.638528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:10.638808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:10.639113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:10.694378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:10.695825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:10.704617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1318/2632] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:10 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:46.268611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:46.270098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:46.325736 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692899-2d08-44b4-9aa0-df40ec5782f2 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:46.329309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:46.329940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:46.330223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:46.330498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:46.332259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:46.341443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:46.342857 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:46.350547 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1315/2633] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:52.109017 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:52.118635 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e4f8-6ebe-43b1-991b-0ae1c1f26f98 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:52.122346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:52.123000 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:52.123305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:52.123605 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:52.125338 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:52.200818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:52.202223 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ed83c-396e-48c5-98c3-db738c6d311b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:52.219447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1319/2634] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:52 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:54.354854 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:54.418977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5363b-5c0a-411e-b166-b4857da3dbd8 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:54.423558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:54.424389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:54.424668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:54.424940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] PATH_INFO: `/v3/users/f381009b6e624ee7be8ae75d2bfe642c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:54.426136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f381009b6e624ee7be8ae75d2bfe642c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:54.428103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:54.472280 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f381009b6e624ee7be8ae75d2bfe642c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:54.473049 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f381009b6e624ee7be8ae75d2bfe642c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:54.484688 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f381009b6e624ee7be8ae75d2bfe642c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:54.485313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f381009b6e624ee7be8ae75d2bfe642c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:54.493470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f381009b6e624ee7be8ae75d2bfe642c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:54.505536 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1316/2635] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:54 2021] DELETE /identity/v3/users/f381009b6e624ee7be8ae75d2bfe642c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:54.509837 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:54.510327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:54.510510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:54.527390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:54.528590 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:54.588232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1320/2636] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:54.599523 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:54.600964 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:54.660474 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb35373-73e7-4ca2-b1f5-06c67e08fc5e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:54.664731 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:54.665371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:54.665653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:54.666069 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:54.675676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:54.677144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:54.687097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1317/2637] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:55.122215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:55.123775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:55.136588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6ce1a-5874-4a5d-8837-99a7fe7cfae2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:55.141780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:55.142704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:55.143132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:55.143461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] PATH_INFO: `/v3/projects/8375ed2b4aac4c9b9683c5cbcededb21` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:55.144888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8375ed2b4aac4c9b9683c5cbcededb21)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:55.147795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:55.199916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8375ed2b4aac4c9b9683c5cbcededb21', 'request_id': 'req-0c505aee-d1e8-4f29-8394-e57640d66577'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.208674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8375ed2b4aac4c9b9683c5cbcededb21', 'request_id': 'req-0c505aee-d1e8-4f29-8394-e57640d66577'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.217868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8375ed2b4aac4c9b9683c5cbcededb21', 'request_id': 'req-0c505aee-d1e8-4f29-8394-e57640d66577'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.232129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] The token cache is being invalidate because project 8375ed2b4aac4c9b9683c5cbcededb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:55.232529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.233277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.235449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1321/2638] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:55 2021] DELETE /identity/v3/projects/8375ed2b4aac4c9b9683c5cbcededb21 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:55.239514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:55.250352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2d38-4ad7-4829-b7e0-b1e027de74f0 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:55.252570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:55.254045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:55.326224 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:55.327521 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:55.328955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:55.328955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] PATH_INFO: `/v3/users/a1b72134779942c3888728bdfb381a19` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:55.329965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b72134779942c3888728bdfb381a19)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:55.332364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:55.387431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505aee-d1e8-4f29-8394-e57640d66577 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:55.404102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b72134779942c3888728bdfb381a19'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.404677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b72134779942c3888728bdfb381a19'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.415597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:55.416995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:55.419208 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:55.420280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:55.423508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:55.433454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b72134779942c3888728bdfb381a19'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.434177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b72134779942c3888728bdfb381a19'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.444004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b72134779942c3888728bdfb381a19'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.445463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:55.447244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6f68c-11f4-4e2d-933c-51381ad0f4c8 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:55.457156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1318/2639] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:55 2021] DELETE /identity/v3/users/a1b72134779942c3888728bdfb381a19 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:55.458997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1322/2640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:25:55.728885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:55.730408 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:55.815821 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006ceab-a485-486e-b784-a7b0985ae3d3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:55.821370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90659576-4786-4190-a317-9824929853f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:55.823056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90659576-4786-4190-a317-9824929853f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:55.823056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90659576-4786-4190-a317-9824929853f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:55.823056 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90659576-4786-4190-a317-9824929853f9 admin admin] PATH_INFO: `/v3/projects/30986e7ea7ed4be7b25f4f4596ac813b` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:55.824209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90659576-4786-4190-a317-9824929853f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30986e7ea7ed4be7b25f4f4596ac813b)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:55.826195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90659576-4786-4190-a317-9824929853f9 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:55.880581 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-90659576-4786-4190-a317-9824929853f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30986e7ea7ed4be7b25f4f4596ac813b', 'request_id': 'req-90659576-4786-4190-a317-9824929853f9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.887207 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-90659576-4786-4190-a317-9824929853f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30986e7ea7ed4be7b25f4f4596ac813b', 'request_id': 'req-90659576-4786-4190-a317-9824929853f9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.894480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-90659576-4786-4190-a317-9824929853f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30986e7ea7ed4be7b25f4f4596ac813b', 'request_id': 'req-90659576-4786-4190-a317-9824929853f9'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.905941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-90659576-4786-4190-a317-9824929853f9 admin admin] The token cache is being invalidate because project 30986e7ea7ed4be7b25f4f4596ac813b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:55.906138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-90659576-4786-4190-a317-9824929853f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.906775 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-90659576-4786-4190-a317-9824929853f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:55.908317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1319/2641] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:55 2021] DELETE /identity/v3/projects/30986e7ea7ed4be7b25f4f4596ac813b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:55.913897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:55.914339 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:55.914597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:55.933629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:55.935013 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:56.008822 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1323/2642] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:25:56.017006 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.017299 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.017582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.040476 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:56.041879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:56.054451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1320/2643] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:56.058597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.069664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55c7fb-05c8-49aa-a774-4b2a74748aad None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.075968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.076625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.076905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.077174 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.077911 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:25:56.078216 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.079863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.097712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1324/2644] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:25:56.102723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.114625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26716680-0646-48e2-85ae-6c48cae51381 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.120403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.121060 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.121341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.121615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.122459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.124264 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.162388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1321/2645] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:56.166308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.176627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc0303-7edd-48e3-861f-7693d78b31d2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.236596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.238830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.239294 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.239674 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.240620 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.243299 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.265595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1325/2646] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:56.269620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.280641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d951d-7936-49d4-a77c-f72b960647a7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.285991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.286771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.286933 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.287248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.288005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.289690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.302419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1322/2647] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:56.307265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.317788 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6b920-52c9-485e-a346-194fcf34ccc1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.323403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311d989-0aca-4880-a48c-a235cc8099c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.324235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d989-0aca-4880-a48c-a235cc8099c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.324520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d989-0aca-4880-a48c-a235cc8099c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.324868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d989-0aca-4880-a48c-a235cc8099c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.325889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311d989-0aca-4880-a48c-a235cc8099c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.328830 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311d989-0aca-4880-a48c-a235cc8099c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.339733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1326/2648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:56.344403 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.355073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc74341-0293-4554-8e83-91488d61b40e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.359972 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.360840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.361117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.361564 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] PATH_INFO: `/v3/projects/fe136f2cb9924e8896ecbb6c0b6f5b62/users/eda0fe7a12e54a3fa129c26cfbaf3ea7/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.387718 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe136f2cb9924e8896ecbb6c0b6f5b62, user_id=eda0fe7a12e54a3fa129c26cfbaf3ea7, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.390710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.405050 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1323/2649] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:56 2021] PUT /identity/v3/projects/fe136f2cb9924e8896ecbb6c0b6f5b62/users/eda0fe7a12e54a3fa129c26cfbaf3ea7/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:56.415849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.416224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.416698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.446399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] MFA Rules not processed for user `eda0fe7a12e54a3fa129c26cfbaf3ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:56.447840 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:56.516928 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1327/2650] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:56.521947 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.585174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba087-7509-4948-a428-34d09f45f9ff admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.589946 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.590594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.590904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.591213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.591917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.593884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.620981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1324/2651] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:56.624955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.636931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de632c1-a0f0-4bd0-8525-af72124b45e3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.704572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.705235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.705520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.705795 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.706496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.708431 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.728511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1328/2652] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:25:56.733128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.749171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ac87-db8a-4acc-ad8c-0602e6074eb6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.754249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.754909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.755223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.755497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.756232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.757950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.770151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1325/2653] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:56.774803 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.785082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12805-8c90-41b6-b557-3ef7f47a69ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.790592 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.791503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.791815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.792092 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] PATH_INFO: `/v3/projects/ea5851e48f18404880c6c80712202c74/users/df74ceeb88744ef4b66cb97abba98b59/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.807572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5851e48f18404880c6c80712202c74, user_id=df74ceeb88744ef4b66cb97abba98b59, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.810184 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.822455 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1329/2654] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:56 2021] PUT /identity/v3/projects/ea5851e48f18404880c6c80712202c74/users/df74ceeb88744ef4b66cb97abba98b59/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:56.826376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.836475 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c773f-e629-48a2-9215-700ce022e3ce admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.890921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac58ea2-b28d-4e75-bde8-1f4c00d48565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.892179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58ea2-b28d-4e75-bde8-1f4c00d48565 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.892465 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58ea2-b28d-4e75-bde8-1f4c00d48565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.892742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58ea2-b28d-4e75-bde8-1f4c00d48565 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.893466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac58ea2-b28d-4e75-bde8-1f4c00d48565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.895120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac58ea2-b28d-4e75-bde8-1f4c00d48565 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.904953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1326/2655] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:56.908983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:56.919454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0649a-0417-443b-9005-78bcd5198aee admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:56.924040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:56.924916 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.925203 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.925489 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] PATH_INFO: `/v3/projects/ea5851e48f18404880c6c80712202c74/users/df74ceeb88744ef4b66cb97abba98b59/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.927547 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5851e48f18404880c6c80712202c74, user_id=df74ceeb88744ef4b66cb97abba98b59, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:56.930175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:56.940138 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1330/2656] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:56 2021] PUT /identity/v3/projects/ea5851e48f18404880c6c80712202c74/users/df74ceeb88744ef4b66cb97abba98b59/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:25:56.950712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7debac-71fe-4e2a-b5d4-63dce67f02d5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:56.951002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7debac-71fe-4e2a-b5d4-63dce67f02d5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:56.951312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7debac-71fe-4e2a-b5d4-63dce67f02d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:56.990689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-4d7debac-71fe-4e2a-b5d4-63dce67f02d5 None None] MFA Rules not processed for user `df74ceeb88744ef4b66cb97abba98b59`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:56.992119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4d7debac-71fe-4e2a-b5d4-63dce67f02d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:57.059496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1327/2657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:56 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:57.065651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:57.124694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc8dc-9bc1-49d7-9a4e-8df4142bc9a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:57.129310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:57.130150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:57.130428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:57.130701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] PATH_INFO: `/v3/users/eda0fe7a12e54a3fa129c26cfbaf3ea7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:57.131925 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda0fe7a12e54a3fa129c26cfbaf3ea7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:57.133848 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:57.177494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda0fe7a12e54a3fa129c26cfbaf3ea7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.183816 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda0fe7a12e54a3fa129c26cfbaf3ea7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.184473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda0fe7a12e54a3fa129c26cfbaf3ea7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.195412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda0fe7a12e54a3fa129c26cfbaf3ea7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.202101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda0fe7a12e54a3fa129c26cfbaf3ea7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.207931 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1331/2658] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:57 2021] DELETE /identity/v3/users/eda0fe7a12e54a3fa129c26cfbaf3ea7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:57.212931 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:57.213241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:57.213516 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:57.231135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:57.232527 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:57.288452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1328/2659] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:57.298649 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:57.300061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:57.354487 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e106fb-7b45-46b4-95eb-f298a40b2d97 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:57.358192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:57.358828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:57.359140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:57.359423 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:57.369069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:57.370491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:57.379593 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1332/2660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:25:57.628720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:57.630163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:57.642021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ec7b4-08a7-4bb7-a4de-d3aecd628bc9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:57.646725 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:57.647635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:57.647929 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:57.648710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] PATH_INFO: `/v3/projects/fe136f2cb9924e8896ecbb6c0b6f5b62` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:57.649907 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe136f2cb9924e8896ecbb6c0b6f5b62)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:57.651885 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:57.696924 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe136f2cb9924e8896ecbb6c0b6f5b62', 'request_id': 'req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.702898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe136f2cb9924e8896ecbb6c0b6f5b62', 'request_id': 'req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.711473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe136f2cb9924e8896ecbb6c0b6f5b62', 'request_id': 'req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.722676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] The token cache is being invalidate because project fe136f2cb9924e8896ecbb6c0b6f5b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:57.722960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.723960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.725484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1329/2661] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:57 2021] DELETE /identity/v3/projects/fe136f2cb9924e8896ecbb6c0b6f5b62 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:25:57.734247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:57.748144 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e1cf0-6648-4d7b-96df-bb671f8136fd service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:57.803209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:57.804063 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:57.804880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:57.805147 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] PATH_INFO: `/v3/users/df74ceeb88744ef4b66cb97abba98b59` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:57.806342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=df74ceeb88744ef4b66cb97abba98b59)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:57.808250 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:57.854715 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df74ceeb88744ef4b66cb97abba98b59'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.861273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df74ceeb88744ef4b66cb97abba98b59'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.861945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df74ceeb88744ef4b66cb97abba98b59'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.874892 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df74ceeb88744ef4b66cb97abba98b59'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.883065 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a960b6a3-0bbd-4e2c-ac4e-8e2340b82cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df74ceeb88744ef4b66cb97abba98b59'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:57.889354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1333/2662] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:25:57 2021] DELETE /identity/v3/users/df74ceeb88744ef4b66cb97abba98b59 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:58.155976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.157508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:58.174151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6671-e0f9-4a75-8ef6-b928e3b28e8d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.230742 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.231596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.231889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.232166 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] PATH_INFO: `/v3/projects/ea5851e48f18404880c6c80712202c74` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.233495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5851e48f18404880c6c80712202c74)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.235528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.282141 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5851e48f18404880c6c80712202c74', 'request_id': 'req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:58.287942 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5851e48f18404880c6c80712202c74', 'request_id': 'req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:58.296559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5851e48f18404880c6c80712202c74', 'request_id': 'req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:58.306992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] The token cache is being invalidate because project ea5851e48f18404880c6c80712202c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:25:58.307316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:58.307940 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-5ef171d9-466b-4701-b65c-bc5b96f1ebfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:25:58.309470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1330/2663] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:25:58 2021] DELETE /identity/v3/projects/ea5851e48f18404880c6c80712202c74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:58.315123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.315576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.315691 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.333237 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:58.334435 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:58.393513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1334/2664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:58.401902 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.402193 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.402478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.421046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:58.422246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:58.430596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1331/2665] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:58.434733 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.444102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25068f4b-2738-47e3-b811-a222a6c03379 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.449344 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.449980 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.450260 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.450556 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.451317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:25:58.451622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.453193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.464320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1335/2666] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:25:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:25:58.468448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.477612 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e43ff-7fac-41ac-bde1-fcae314811aa None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.482295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.482848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.483162 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.483435 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.484119 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.486009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.511654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1332/2667] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:58.515595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.525111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b2b9-0c07-440e-8ead-5295326fd49c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.578454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.579140 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.579428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.579702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.580385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.582272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.600647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1336/2668] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/users => generated 293 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:58.604698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.615110 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718b27a-c105-43aa-8bcf-69a9a86dcef6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.620202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.620847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.621128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.621400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.622129 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.623760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.634394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1333/2669] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:58.638129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.647772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1798-fa13-4724-8d3d-ece25960a63a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.652290 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1afa-feb4-4a91-9b4d-c11d26674a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.652950 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1afa-feb4-4a91-9b4d-c11d26674a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.653662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1afa-feb4-4a91-9b4d-c11d26674a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.653662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1afa-feb4-4a91-9b4d-c11d26674a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.654355 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1afa-feb4-4a91-9b4d-c11d26674a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.655819 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1afa-feb4-4a91-9b4d-c11d26674a5d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.665744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1337/2670] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:58.669790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.680171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef939a0-1717-4eeb-bb62-a6436cd525ac admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.684901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.685765 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.686068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.686344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] PATH_INFO: `/v3/projects/bff96c9404434d89a988bb218868370a/users/6e949415101245ce805275165d4f09f7/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.701269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff96c9404434d89a988bb218868370a, user_id=6e949415101245ce805275165d4f09f7, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.703909 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.716352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1334/2671] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:58 2021] PUT /identity/v3/projects/bff96c9404434d89a988bb218868370a/users/6e949415101245ce805275165d4f09f7/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:58.727937 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.728230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.728511 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.755337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] MFA Rules not processed for user `6e949415101245ce805275165d4f09f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:58.756461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:58.817461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1338/2672] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:58.821995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.881566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906bccd-d0af-4d68-a286-869e2fee2b23 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.886175 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.886814 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.887114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.887384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.888061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.889934 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:58.914220 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1335/2673] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:58.918379 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:58.928689 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b2dc-9ac8-4bc9-9bf2-81d4d9bc3f9e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:58.982694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:58.983390 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:58.983669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:58.983969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:58.984654 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:58.986561 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.007997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1339/2674] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:25:58 2021] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:25:59.012083 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:59.022115 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027404-c978-48ce-999f-8ea7abeeef63 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:59.027009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:59.027705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.027990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.028268 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.029010 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:59.030709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.045117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1336/2675] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:25:59.046247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:59.057054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c80bc-831d-451c-9fd1-7c6406845527 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:59.061685 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:59.062550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.062828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.063129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] PATH_INFO: `/v3/projects/00817cd1621148ce9445098610c4094a/users/a3a8de0b66e74cc7901294c0989ca74e/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.075716 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:59.077511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:59.077687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00817cd1621148ce9445098610c4094a, user_id=a3a8de0b66e74cc7901294c0989ca74e, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:59.080350 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.093818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1340/2676] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:59 2021] PUT /identity/v3/projects/00817cd1621148ce9445098610c4094a/users/a3a8de0b66e74cc7901294c0989ca74e/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:59.097564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:59.135796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94b35-7edd-40c9-8ed4-aab9313ac2ed admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:59.157230 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1d03-98e4-476e-809a-5fd01cd67dd7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:59.162036 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:59.162692 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.162999 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.163301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.164588 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:59.166178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.178763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1341/2677] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:25:59.179868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:59.183352 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:59.183987 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.184272 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.184550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.186396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:59.189050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2b66-126e-4977-be19-463b073f2ddf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:59.193627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:59.194461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.194744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.195058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] PATH_INFO: `/v3/projects/00817cd1621148ce9445098610c4094a/users/a3a8de0b66e74cc7901294c0989ca74e/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.198008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00817cd1621148ce9445098610c4094a, user_id=a3a8de0b66e74cc7901294c0989ca74e, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:59.198290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:59.199777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d4aa6-9ef0-45a6-a096-ab31ed3de198 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.200629 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.209339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1337/2678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:25:59.211300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1342/2679] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:25:59 2021] PUT /identity/v3/projects/00817cd1621148ce9445098610c4094a/users/a3a8de0b66e74cc7901294c0989ca74e/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:25:59.221101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.221387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.221668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.247303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] MFA Rules not processed for user `a3a8de0b66e74cc7901294c0989ca74e`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:25:59.248558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:59.314202 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1338/2680] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:25:59 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:25:59.323923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:25:59.325626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:25:59.382182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d600-ec79-4cb0-b3d9-6c61b53855b8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:25:59.385895 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:25:59.386529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:25:59.386812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:25:59.387118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:25:59.442457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:25:59.443922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:25:59.452688 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1343/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:25:59 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:02.645185 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:02.647131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:02.718270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997fce8-3217-4487-ab50-3250da9a2756 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:02.725374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:02.726324 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:02.726597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:02.726867 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] PATH_INFO: `/v3/users/0a4d52d1d56e44fe97650262ca2e68df` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:02.728111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4d52d1d56e44fe97650262ca2e68df)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:02.730029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:02.778094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4d52d1d56e44fe97650262ca2e68df'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:02.778761 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4d52d1d56e44fe97650262ca2e68df'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:02.791600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4d52d1d56e44fe97650262ca2e68df'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:02.793287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4d52d1d56e44fe97650262ca2e68df'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:02.800567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8b19d254-f5c5-4494-9fbc-44f0942741ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4d52d1d56e44fe97650262ca2e68df'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:02.812780 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1339/2682] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:02 2021] DELETE /identity/v3/users/0a4d52d1d56e44fe97650262ca2e68df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:02.978445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:02.989628 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a34b-7850-4c4a-b13c-3903a3a8606b service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.051919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.052810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.053089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.053360 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] PATH_INFO: `/v3/projects/da53d564588b46b7bd658659f40a6ded` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.055023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da53d564588b46b7bd658659f40a6ded)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.056919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.108707 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da53d564588b46b7bd658659f40a6ded', 'request_id': 'req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:03.114846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da53d564588b46b7bd658659f40a6ded', 'request_id': 'req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:03.123273 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da53d564588b46b7bd658659f40a6ded', 'request_id': 'req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:03.134298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] The token cache is being invalidate because project da53d564588b46b7bd658659f40a6ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:03.134583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:03.135231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aaec1e6d-d2d0-475f-93ae-d8cdd7693f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:03.136759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1344/2683] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:02 2021] DELETE /identity/v3/projects/da53d564588b46b7bd658659f40a6ded => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:03.144267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.144556 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.144835 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.162507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:03.163737 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:03.219526 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1340/2684] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:03.228048 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.228331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.228603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.252472 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:03.253665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:03.261616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1345/2685] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:03.265822 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.275738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956297c2-710e-46dc-97f3-4c368295d416 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.280325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.280990 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.281259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.281534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.282406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:03.282747 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.284473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.296459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1341/2686] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:26:03.300855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.310656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e220a-c347-42df-8b4e-e6775d627036 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.315359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.315998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.316279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.316553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.317276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.319170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.345919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1346/2687] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:03.347517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.357686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b56dc-37c7-473f-ae72-2c56fccaedab admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.410734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.411343 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.411624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.411903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.412605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.415105 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.434076 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1342/2688] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:03.438108 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.448320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dfbca-efeb-4bc7-823a-fa7857be1039 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.452956 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.453595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.453877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.454149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.454871 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.456471 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.466591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1347/2689] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:03.470388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.480627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fe27-8420-4169-8cfe-a27285ed16f1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.485242 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab786ebb-c382-4ce3-bebf-20351256fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.485879 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab786ebb-c382-4ce3-bebf-20351256fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.486169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab786ebb-c382-4ce3-bebf-20351256fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.486446 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab786ebb-c382-4ce3-bebf-20351256fc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.487219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab786ebb-c382-4ce3-bebf-20351256fc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.489050 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab786ebb-c382-4ce3-bebf-20351256fc20 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.499372 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1343/2690] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:03.503139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.512810 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070353d3-9ace-4f69-98bd-9b3c1a0d2b3a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.517317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.518189 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.518466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.518738 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] PATH_INFO: `/v3/projects/0e39f713eeec4eb9b41fb33af74b076a/users/8c6ee00c7ce34f68a787b5c48d29d420/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.532457 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e39f713eeec4eb9b41fb33af74b076a, user_id=8c6ee00c7ce34f68a787b5c48d29d420, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.535061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.548088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1348/2691] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:03 2021] PUT /identity/v3/projects/0e39f713eeec4eb9b41fb33af74b076a/users/8c6ee00c7ce34f68a787b5c48d29d420/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:03.558663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.558981 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.559330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.585267 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] MFA Rules not processed for user `8c6ee00c7ce34f68a787b5c48d29d420`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:03.586439 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:03.649999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1344/2692] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:03.654575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.676370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.677777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:03.715301 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2c8f6-2ec5-47c6-adb6-6333ca782506 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.720186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.720835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.721116 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.721397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.722105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.724033 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.731943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e1f30-3246-40f0-ad89-6bb1c9706e8e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.735617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.736247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.736529 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.736803 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.738824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:03.753303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1349/2693] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:03.754454 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.799782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.801374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.810919 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1345/2694] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:03 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:26:03.813134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210e035-e275-45be-8d82-008a1accf584 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.818325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.818977 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.819302 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.819596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.820311 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.822233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.845393 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1350/2695] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:03 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:03.846588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.857420 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb615-e726-4d19-9aa8-f13da3c9c4c9 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.862120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.863111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.863458 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.863794 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.864611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.866247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.876228 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1346/2696] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:03.880482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.890214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f85f2c-faee-40c4-a1bd-7fc3846739b1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:03.894794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:03.895687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:03.895968 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:03.896247 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] PATH_INFO: `/v3/projects/bba373a03d334b16bc3ea9a6ee05e49a/users/b2dd7cd9a22549248c9dc1edc2ad0fd0/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:03.911003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba373a03d334b16bc3ea9a6ee05e49a, user_id=b2dd7cd9a22549248c9dc1edc2ad0fd0, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:03.914209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:03.927219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1351/2697] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:03 2021] PUT /identity/v3/projects/bba373a03d334b16bc3ea9a6ee05e49a/users/b2dd7cd9a22549248c9dc1edc2ad0fd0/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:03.932215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:03.943492 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564fa1-08f9-4cec-9061-8b71ecf7e88b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:04.001099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa806a-45bf-4468-9f88-115db53e3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:04.001781 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa806a-45bf-4468-9f88-115db53e3ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.002100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa806a-45bf-4468-9f88-115db53e3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.002401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa806a-45bf-4468-9f88-115db53e3ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.003250 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa806a-45bf-4468-9f88-115db53e3ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:04.005079 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa806a-45bf-4468-9f88-115db53e3ed1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:04.015596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1347/2698] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:04.019959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:04.030839 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79aebc-6dea-4b42-a89d-a1a055c263aa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:04.035794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:04.036626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.036976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.037318 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] PATH_INFO: `/v3/projects/bba373a03d334b16bc3ea9a6ee05e49a/users/b2dd7cd9a22549248c9dc1edc2ad0fd0/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.039835 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba373a03d334b16bc3ea9a6ee05e49a, user_id=b2dd7cd9a22549248c9dc1edc2ad0fd0, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:04.042828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:04.063086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1352/2699] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:04 2021] PUT /identity/v3/projects/bba373a03d334b16bc3ea9a6ee05e49a/users/b2dd7cd9a22549248c9dc1edc2ad0fd0/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:04.067501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.067810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.068066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.097798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] MFA Rules not processed for user `b2dd7cd9a22549248c9dc1edc2ad0fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:04.099000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:04.166102 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1348/2700] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:04 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:04.176675 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:04.228690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767331a8-a5eb-4b4b-90e0-1992a61ebfe2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:04.232268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11cb9-b8f6-4eed-9c16-f54bd0973424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:04.232886 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11cb9-b8f6-4eed-9c16-f54bd0973424 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.233166 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11cb9-b8f6-4eed-9c16-f54bd0973424 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.233505 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11cb9-b8f6-4eed-9c16-f54bd0973424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.242631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11cb9-b8f6-4eed-9c16-f54bd0973424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:04.244089 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11cb9-b8f6-4eed-9c16-f54bd0973424 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:04.253201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1353/2701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:04 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:04.323227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:04.382832 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83011-cfb4-474c-83aa-1066849fb509 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:04.387406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:04.388249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.388525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.388792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] PATH_INFO: `/v3/users/8c6ee00c7ce34f68a787b5c48d29d420` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.389980 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6ee00c7ce34f68a787b5c48d29d420)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:04.391927 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:04.435375 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6ee00c7ce34f68a787b5c48d29d420'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.436021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6ee00c7ce34f68a787b5c48d29d420'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.447915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6ee00c7ce34f68a787b5c48d29d420'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.448541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6ee00c7ce34f68a787b5c48d29d420'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.455201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6ee00c7ce34f68a787b5c48d29d420'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.467219 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1349/2702] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:04 2021] DELETE /identity/v3/users/8c6ee00c7ce34f68a787b5c48d29d420 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:04.471767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.472058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.472337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.490310 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:04.491502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:04.546981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1354/2703] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:04.557262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:04.558648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:04.614412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424f050-fabe-486d-80c4-fcb1c5ff3827 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:04.618101 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:04.618728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.619012 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.619319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.628124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:04.629548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:04.638638 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1350/2704] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:04.888768 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:04.890248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:04.902441 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd048fd7-4dc2-4634-98a3-c74e99dfcd8d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:04.907023 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:04.907901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:04.908178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:04.908447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] PATH_INFO: `/v3/projects/0e39f713eeec4eb9b41fb33af74b076a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:04.909641 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e39f713eeec4eb9b41fb33af74b076a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:04.911572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:04.958444 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e39f713eeec4eb9b41fb33af74b076a', 'request_id': 'req-61e41a98-4848-42e7-9d0e-aa200d04c385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.965159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e39f713eeec4eb9b41fb33af74b076a', 'request_id': 'req-61e41a98-4848-42e7-9d0e-aa200d04c385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.972341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e39f713eeec4eb9b41fb33af74b076a', 'request_id': 'req-61e41a98-4848-42e7-9d0e-aa200d04c385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.981970 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] The token cache is being invalidate because project 0e39f713eeec4eb9b41fb33af74b076a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:04.982251 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.982861 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:04.984398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1355/2705] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:04 2021] DELETE /identity/v3/projects/0e39f713eeec4eb9b41fb33af74b076a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:04.988597 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:04.997974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73095-a884-4305-8680-6d1609ac9aed service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.051992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.052755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.053040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.053311 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] PATH_INFO: `/v3/users/b2dd7cd9a22549248c9dc1edc2ad0fd0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.054517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dd7cd9a22549248c9dc1edc2ad0fd0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.056450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.100810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dd7cd9a22549248c9dc1edc2ad0fd0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.101484 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dd7cd9a22549248c9dc1edc2ad0fd0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.112848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dd7cd9a22549248c9dc1edc2ad0fd0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.113472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dd7cd9a22549248c9dc1edc2ad0fd0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.121271 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-380e9d9b-d665-4c4f-8653-eb451c9ec56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dd7cd9a22549248c9dc1edc2ad0fd0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.133719 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1351/2706] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:04 2021] DELETE /identity/v3/users/b2dd7cd9a22549248c9dc1edc2ad0fd0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:05.410725 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.412900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:05.428117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e41a98-4848-42e7-9d0e-aa200d04c385 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.486551 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f48787-d884-467c-b428-3373afda217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.487681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f48787-d884-467c-b428-3373afda217d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.487958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f48787-d884-467c-b428-3373afda217d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.488228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f48787-d884-467c-b428-3373afda217d admin admin] PATH_INFO: `/v3/projects/bba373a03d334b16bc3ea9a6ee05e49a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.489403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f48787-d884-467c-b428-3373afda217d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba373a03d334b16bc3ea9a6ee05e49a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.491305 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f48787-d884-467c-b428-3373afda217d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.533945 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-27f48787-d884-467c-b428-3373afda217d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba373a03d334b16bc3ea9a6ee05e49a', 'request_id': 'req-27f48787-d884-467c-b428-3373afda217d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.540422 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-27f48787-d884-467c-b428-3373afda217d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba373a03d334b16bc3ea9a6ee05e49a', 'request_id': 'req-27f48787-d884-467c-b428-3373afda217d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.548209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-27f48787-d884-467c-b428-3373afda217d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba373a03d334b16bc3ea9a6ee05e49a', 'request_id': 'req-27f48787-d884-467c-b428-3373afda217d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.558526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-27f48787-d884-467c-b428-3373afda217d admin admin] The token cache is being invalidate because project bba373a03d334b16bc3ea9a6ee05e49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:05.558809 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-27f48787-d884-467c-b428-3373afda217d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.559445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-27f48787-d884-467c-b428-3373afda217d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:05.560973 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1356/2707] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:05 2021] DELETE /identity/v3/projects/bba373a03d334b16bc3ea9a6ee05e49a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:05.566702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.566930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.567232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.585813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:05.587020 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:05.649587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1352/2708] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:05.657638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.658057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.658336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.677580 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:05.678781 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:05.687988 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1357/2709] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:05.692729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.702542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff329b-2e9f-4fcd-9e61-e5e8deb531fe None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.707278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.707918 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.708198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.708472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.709269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:05.709573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.711300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.723109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1353/2710] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:26:05.729486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.738981 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1a33-4cd3-4708-bcab-ecc9097103db None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.744766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.745417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.745704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.746168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.746870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.748794 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.773741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1358/2711] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:05 2021] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:05.777866 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.787573 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4cb57-74dc-4511-a173-a8941b575f42 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.841145 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.841719 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.842002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.842278 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.843000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.844932 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.864533 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1354/2712] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:05 2021] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:05.869135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.879478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69bedc-eb51-45dc-ae56-8c35b42654b5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.884180 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.884824 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.885101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.885373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.886095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.887711 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.898275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1359/2713] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:05.902030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.911704 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f159-220c-4fa9-b9b5-ec98508e91e4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.916841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1ea1a-ee82-4292-b900-13343a90593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.917478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1ea1a-ee82-4292-b900-13343a90593e admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.917762 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1ea1a-ee82-4292-b900-13343a90593e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.918040 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1ea1a-ee82-4292-b900-13343a90593e admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.918767 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1ea1a-ee82-4292-b900-13343a90593e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.920401 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1ea1a-ee82-4292-b900-13343a90593e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.930030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1355/2714] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:05.933759 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:05.943287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33142-b5a1-4340-abfa-741677aab7de admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:05.947832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:05.948684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.948962 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.949233 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] PATH_INFO: `/v3/projects/c6e097052e65432190be198786e1771d/users/5a83fe307acf4f1e82ca30fcb01cf367/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:05.963827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e097052e65432190be198786e1771d, user_id=5a83fe307acf4f1e82ca30fcb01cf367, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:05.966417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:05.979380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1360/2715] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:05 2021] PUT /identity/v3/projects/c6e097052e65432190be198786e1771d/users/5a83fe307acf4f1e82ca30fcb01cf367/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:05.989812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:05.990321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:05.990432 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.015550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] MFA Rules not processed for user `5a83fe307acf4f1e82ca30fcb01cf367`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:06.016752 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:06.077941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1356/2716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:05 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:06.082320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.141517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20347c-57a0-4ae1-b964-25a9a843b088 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.146054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.146687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.146960 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.147255 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.148463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.150315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.174411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1361/2717] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:06 2021] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:06.178384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.188701 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50999b-06d9-450f-82c1-2d5c1df63d83 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.241234 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.241874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.242154 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.242448 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.243187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.245128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.264038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1357/2718] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:06 2021] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:06.267965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.278550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6fcfb-d0ff-4b30-a022-2f18ccee0580 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.283209 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.283851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.284136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.284416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.285141 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.286723 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.296941 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1362/2719] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:06.300792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.310481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92214-9b83-4557-8894-fef9a19e0fe6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.315270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.316169 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.316454 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.316760 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] PATH_INFO: `/v3/projects/fdc5b5d4131348daae6e7cda1fbf5100/users/6668df1d04704831b205ca6be96ab29d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.331691 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc5b5d4131348daae6e7cda1fbf5100, user_id=6668df1d04704831b205ca6be96ab29d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.334377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.347400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1358/2720] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:06 2021] PUT /identity/v3/projects/fdc5b5d4131348daae6e7cda1fbf5100/users/6668df1d04704831b205ca6be96ab29d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:06.351298 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.361004 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140674-add2-4b9c-bfe1-3ccbc192a957 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.417383 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4aee-3913-4973-bcfd-9837d8c947b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.418043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4aee-3913-4973-bcfd-9837d8c947b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.418399 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4aee-3913-4973-bcfd-9837d8c947b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.418626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4aee-3913-4973-bcfd-9837d8c947b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.419380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4aee-3913-4973-bcfd-9837d8c947b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.421126 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4aee-3913-4973-bcfd-9837d8c947b4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.431204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1363/2721] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:06 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:06.435724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.446953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb2588-b5f9-4bd4-aacc-2b18702e72a6 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.452017 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.452889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.453174 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.453451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] PATH_INFO: `/v3/projects/fdc5b5d4131348daae6e7cda1fbf5100/users/6668df1d04704831b205ca6be96ab29d/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.455467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc5b5d4131348daae6e7cda1fbf5100, user_id=6668df1d04704831b205ca6be96ab29d, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.458070 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.469295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1359/2722] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:06 2021] PUT /identity/v3/projects/fdc5b5d4131348daae6e7cda1fbf5100/users/6668df1d04704831b205ca6be96ab29d/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:06.481267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.481563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.481846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.507583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] MFA Rules not processed for user `6668df1d04704831b205ca6be96ab29d`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:06.509303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:06.573168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1364/2723] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:06 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:06.583493 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.585135 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:06.640384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3557bf-08bc-4a9d-8a6e-ff44cc20e0bf admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.644407 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.644884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.645163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.645434 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.654619 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.656097 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.665771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1360/2724] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:06 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:06.746384 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:06.755804 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dede97d-59b0-4480-afc5-b14836b46351 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:06.760178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007899aa-0d85-4201-af58-3961d38de2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:06.760836 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007899aa-0d85-4201-af58-3961d38de2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:06.761119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007899aa-0d85-4201-af58-3961d38de2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:06.761391 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007899aa-0d85-4201-af58-3961d38de2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:06.814921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007899aa-0d85-4201-af58-3961d38de2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:06.816370 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007899aa-0d85-4201-af58-3961d38de2f2 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:06.825503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1365/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:06 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:08.621627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:08.623013 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:08.686569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564679-feac-4691-8b67-5b34d752de6a service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:08.691028 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c339-5871-4732-a867-dd614840409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:08.691894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c339-5871-4732-a867-dd614840409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:08.692171 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c339-5871-4732-a867-dd614840409d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:08.692441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c339-5871-4732-a867-dd614840409d admin admin] PATH_INFO: `/v3/users/6e949415101245ce805275165d4f09f7` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:08.693616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556c339-5871-4732-a867-dd614840409d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e949415101245ce805275165d4f09f7)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:08.695534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556c339-5871-4732-a867-dd614840409d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:08.739213 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e949415101245ce805275165d4f09f7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:08.739873 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e949415101245ce805275165d4f09f7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:08.750926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e949415101245ce805275165d4f09f7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:08.751569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e949415101245ce805275165d4f09f7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:08.758586 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e949415101245ce805275165d4f09f7'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:08.770566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1361/2726] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:08 2021] DELETE /identity/v3/users/6e949415101245ce805275165d4f09f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:08.775616 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:08.776086 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:08.776210 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:08.792326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:08.793496 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:08.847696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1366/2727] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:08.857663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:08.859002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:08.913663 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c339-5871-4732-a867-dd614840409d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:08.917345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:08.917971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:08.918254 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:08.918531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:08.927262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:08.928684 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:08.938363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1362/2728] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:09.192187 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:09.193591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:09.205614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9c234-2428-4db0-a6bf-f1f9d70acc2b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:09.210324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:09.211225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:09.211508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:09.211779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] PATH_INFO: `/v3/projects/bff96c9404434d89a988bb218868370a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:09.214557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff96c9404434d89a988bb218868370a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:09.216570 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:09.262134 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff96c9404434d89a988bb218868370a', 'request_id': 'req-f9a27dcb-dae5-49ee-850f-ef189329625f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.267893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff96c9404434d89a988bb218868370a', 'request_id': 'req-f9a27dcb-dae5-49ee-850f-ef189329625f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.275560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff96c9404434d89a988bb218868370a', 'request_id': 'req-f9a27dcb-dae5-49ee-850f-ef189329625f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.285243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] The token cache is being invalidate because project bff96c9404434d89a988bb218868370a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:09.285523 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.286135 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.287664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1367/2729] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:09 2021] DELETE /identity/v3/projects/bff96c9404434d89a988bb218868370a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:09.291699 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:09.300870 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd57f-e9b3-4bd2-883b-1245ea6db57b service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:09.354813 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:09.355710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:09.355995 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:09.356273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] PATH_INFO: `/v3/users/a3a8de0b66e74cc7901294c0989ca74e` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:09.357553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a8de0b66e74cc7901294c0989ca74e)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:09.359548 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:09.404664 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a8de0b66e74cc7901294c0989ca74e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.405380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a8de0b66e74cc7901294c0989ca74e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.417559 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a8de0b66e74cc7901294c0989ca74e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.418248 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a8de0b66e74cc7901294c0989ca74e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.429472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-e8a6b0b5-c786-4332-bc1e-25fa31b78c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a8de0b66e74cc7901294c0989ca74e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.442687 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1363/2730] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:09 2021] DELETE /identity/v3/users/a3a8de0b66e74cc7901294c0989ca74e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:09.713957 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:09.715425 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:09.732365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a27dcb-dae5-49ee-850f-ef189329625f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:09.792118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:09.792965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:09.793238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:09.793507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] PATH_INFO: `/v3/projects/00817cd1621148ce9445098610c4094a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:09.794677 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=00817cd1621148ce9445098610c4094a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:09.796571 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:09.842897 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00817cd1621148ce9445098610c4094a', 'request_id': 'req-5680440f-8500-4b82-9a3a-19ef7d5bc80e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.849478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00817cd1621148ce9445098610c4094a', 'request_id': 'req-5680440f-8500-4b82-9a3a-19ef7d5bc80e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.858805 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00817cd1621148ce9445098610c4094a', 'request_id': 'req-5680440f-8500-4b82-9a3a-19ef7d5bc80e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.871249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] The token cache is being invalidate because project 00817cd1621148ce9445098610c4094a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:09.871513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.872168 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5680440f-8500-4b82-9a3a-19ef7d5bc80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:09.873693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1368/2731] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:09 2021] DELETE /identity/v3/projects/00817cd1621148ce9445098610c4094a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:09.880602 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:09.881137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:09.881137 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:09.902694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:09.903945 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:09.979073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1364/2732] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:09.987873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:09.988241 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:09.988493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.008780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:10.010522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:10.018607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1369/2733] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:10.023003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.034146 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e10fed-1f67-4549-9daf-7caf7cb8bfec None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.038936 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.039753 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.040131 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.040880 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.041317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:10.041682 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.043464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.056694 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1365/2734] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:26:10.061449 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.070549 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3327-abcd-402b-94cb-e2157ff64c57 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.076040 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.076888 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.077359 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.077639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.078342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.080276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.115215 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1370/2735] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:10 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:10.117138 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.130810 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be517959-8d9d-4bce-ba32-01fd47dcf559 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.191801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.192456 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.192735 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.193098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.193686 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.195695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.220389 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1366/2736] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:10 2021] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:10.221665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.232066 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b96c-ae84-4539-9b38-3b100e08c424 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.236821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.237790 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.238090 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.238331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.239158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.240750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.254478 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1371/2737] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:10.256247 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.267648 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16808c5d-779d-419f-9255-4375bf52e333 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.274367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9726e-dcd5-4aca-8da3-0ce7f6d725f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.275695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9726e-dcd5-4aca-8da3-0ce7f6d725f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.275974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9726e-dcd5-4aca-8da3-0ce7f6d725f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.276460 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9726e-dcd5-4aca-8da3-0ce7f6d725f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.277305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9726e-dcd5-4aca-8da3-0ce7f6d725f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.278878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9726e-dcd5-4aca-8da3-0ce7f6d725f8 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.291073 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1367/2738] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:10.293643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.303285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd058bf-7d01-4d18-8f1a-6b9ce8c5b1fc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.308504 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.309365 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.309646 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.309919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] PATH_INFO: `/v3/projects/4057172f9d694e73b6ed7459c85ada30/users/1b015fa36e4b4045af605d1053190588/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.324354 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4057172f9d694e73b6ed7459c85ada30, user_id=1b015fa36e4b4045af605d1053190588, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.326964 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.339627 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1372/2739] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:10 2021] PUT /identity/v3/projects/4057172f9d694e73b6ed7459c85ada30/users/1b015fa36e4b4045af605d1053190588/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:10.350371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.350711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.351023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.377238 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] MFA Rules not processed for user `1b015fa36e4b4045af605d1053190588`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:10.378451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:10.439745 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1368/2740] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:10.450275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:10.451989 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:10.509813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d3d1-b25a-48b0-8f5b-6202cfe5172a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:10.513467 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514504-106e-496c-b0b6-908d930168cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:10.514091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514504-106e-496c-b0b6-908d930168cc service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:10.514380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514504-106e-496c-b0b6-908d930168cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:10.514644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514504-106e-496c-b0b6-908d930168cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:10.523105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514504-106e-496c-b0b6-908d930168cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:10.524651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514504-106e-496c-b0b6-908d930168cc service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:10.533406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1373/2741] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:10 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:11.446886 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:11.448542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:11.516422 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ff7d8-bee5-4a0e-9c26-2566ace6cb47 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:11.521739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:11.522598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:11.522874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:11.523167 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] PATH_INFO: `/v3/users/5a83fe307acf4f1e82ca30fcb01cf367` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:11.524371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a83fe307acf4f1e82ca30fcb01cf367)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:11.526312 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:11.569865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a83fe307acf4f1e82ca30fcb01cf367'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:11.570508 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a83fe307acf4f1e82ca30fcb01cf367'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:11.581618 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a83fe307acf4f1e82ca30fcb01cf367'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:11.582237 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a83fe307acf4f1e82ca30fcb01cf367'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:11.588627 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a83fe307acf4f1e82ca30fcb01cf367'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:11.600258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1369/2742] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:11 2021] DELETE /identity/v3/users/5a83fe307acf4f1e82ca30fcb01cf367 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:11.605244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:11.605763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:11.605873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:11.623243 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:11.624439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:11.680300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1374/2743] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:11.690574 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:11.692003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:11.753009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cc9d6-bad4-4683-9d26-3b05de9e1cf3 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:11.756865 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:11.757495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:11.757774 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:11.758046 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:11.766884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:11.768330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:11.777676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1370/2744] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:12.073407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:12.073734 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:12.088493 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aefd7-272b-47f0-8900-e7f4b1c1710f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:12.094206 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:12.095267 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:12.095553 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:12.095827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] PATH_INFO: `/v3/projects/c6e097052e65432190be198786e1771d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:12.097293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e097052e65432190be198786e1771d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:12.099296 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:12.150577 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e097052e65432190be198786e1771d', 'request_id': 'req-9c97b0fd-aebe-4ff9-8226-c4d662be0358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.157054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e097052e65432190be198786e1771d', 'request_id': 'req-9c97b0fd-aebe-4ff9-8226-c4d662be0358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.166325 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e097052e65432190be198786e1771d', 'request_id': 'req-9c97b0fd-aebe-4ff9-8226-c4d662be0358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.176637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] The token cache is being invalidate because project c6e097052e65432190be198786e1771d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:12.176921 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.177546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.179110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1375/2745] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:12 2021] DELETE /identity/v3/projects/c6e097052e65432190be198786e1771d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:12.183027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:12.192470 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8aad3-1547-4e01-aec4-cda1dc69e855 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:12.247497 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:12.248387 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:12.248665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:12.248937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] PATH_INFO: `/v3/users/6668df1d04704831b205ca6be96ab29d` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:12.250143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6668df1d04704831b205ca6be96ab29d)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:12.252152 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:12.296639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6668df1d04704831b205ca6be96ab29d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.297290 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6668df1d04704831b205ca6be96ab29d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.309089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6668df1d04704831b205ca6be96ab29d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.309772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6668df1d04704831b205ca6be96ab29d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.317088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-855223f9-971f-446e-84bd-090f2aa266aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6668df1d04704831b205ca6be96ab29d'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.331094 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1371/2746] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:12 2021] DELETE /identity/v3/users/6668df1d04704831b205ca6be96ab29d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:12.769398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:12.775680 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:12.799010 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b0fd-aebe-4ff9-8226-c4d662be0358 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:12.870783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:12.871775 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:12.872052 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:12.872324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] PATH_INFO: `/v3/projects/fdc5b5d4131348daae6e7cda1fbf5100` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:12.873621 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc5b5d4131348daae6e7cda1fbf5100)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:12.875557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:12.927470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc5b5d4131348daae6e7cda1fbf5100', 'request_id': 'req-ce3be04a-0a01-4b89-9d7d-049455a3a044'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.934564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc5b5d4131348daae6e7cda1fbf5100', 'request_id': 'req-ce3be04a-0a01-4b89-9d7d-049455a3a044'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.943537 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc5b5d4131348daae6e7cda1fbf5100', 'request_id': 'req-ce3be04a-0a01-4b89-9d7d-049455a3a044'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.955268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] The token cache is being invalidate because project fdc5b5d4131348daae6e7cda1fbf5100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:12.955555 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.956205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ce3be04a-0a01-4b89-9d7d-049455a3a044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:12.958005 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1376/2747] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:12 2021] DELETE /identity/v3/projects/fdc5b5d4131348daae6e7cda1fbf5100 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:12.963596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:12.964088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:12.964197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:12.983164 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:12.984424 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:13.047150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1372/2748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:13.052639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.053128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.053410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.076103 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:13.077337 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:13.085150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1377/2749] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:13.089588 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.099477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e007f-ad92-4e24-b8df-a8f39edb76f5 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.104740 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.105392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.105670 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.105939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.106661 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:13.106962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.108617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.124423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1373/2750] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:26:13.125842 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.134905 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d723-6f6b-425e-8c1e-3f375025539d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.139595 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.140235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.140515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.140793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.141488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.143413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.171014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1378/2751] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:13.175315 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.185680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaf494-272e-476d-a65a-919f07d4ee12 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.241915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.242511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.242797 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.243098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.244359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.246287 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.269081 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1374/2752] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:13.270503 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.281071 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5d2ad-19b7-457a-8951-416bff7f8550 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.285743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.286389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.286664 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.286932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.287716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.289312 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.301575 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1379/2753] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:26:13.305251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.315558 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa10f-0e45-4c60-9288-8f621d622b10 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.320111 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219e89-2f4f-4461-9dc3-f797ac5b0a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.320749 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219e89-2f4f-4461-9dc3-f797ac5b0a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.321027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219e89-2f4f-4461-9dc3-f797ac5b0a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.321298 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219e89-2f4f-4461-9dc3-f797ac5b0a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.322022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219e89-2f4f-4461-9dc3-f797ac5b0a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.323631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219e89-2f4f-4461-9dc3-f797ac5b0a4a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.333276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1375/2754] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:26:13.337949 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.347669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05e1d6-2cda-4104-91ff-9675b14c2501 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.352466 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.354062 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.354461 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.354744 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] PATH_INFO: `/v3/projects/76b0f7c6711343ae8b26e45a9e0a2ef9/users/0316c95b0c0845c0a666c1adceaf6385/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.369412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b0f7c6711343ae8b26e45a9e0a2ef9, user_id=0316c95b0c0845c0a666c1adceaf6385, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.372085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.384502 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1380/2755] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:13 2021] PUT /identity/v3/projects/76b0f7c6711343ae8b26e45a9e0a2ef9/users/0316c95b0c0845c0a666c1adceaf6385/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:13.394808 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.395125 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.395406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.425275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] MFA Rules not processed for user `0316c95b0c0845c0a666c1adceaf6385`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:13.426541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:13.495965 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1376/2756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:13.500128 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.567016 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312ddef-ea94-4bf0-a209-612d4bc571e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.571763 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.572413 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.572698 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.572971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.573681 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.575602 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.604014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1381/2757] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:13.605958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.617180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefbb78-1926-4b2c-997a-0cb614a27ea9 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.674903 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.675855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.676133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.676409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.677142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.679065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.700925 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1377/2758] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:13.704458 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.715244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58757a-53ea-4d99-a0b7-d6e0df220edb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.720029 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.720701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.721001 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.721277 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.722014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.723653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.738488 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1382/2759] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:13.742577 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.752466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f4244-abce-4827-81a5-ebb2ec6d8b9f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.757276 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.758136 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.758423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.758681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] PATH_INFO: `/v3/projects/3f40e149b1504c4b93abfa3b30175672/users/08ef76003566460eb42b0f77f2593358/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.773823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f40e149b1504c4b93abfa3b30175672, user_id=08ef76003566460eb42b0f77f2593358, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.777180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.793065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1378/2760] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:13 2021] PUT /identity/v3/projects/3f40e149b1504c4b93abfa3b30175672/users/08ef76003566460eb42b0f77f2593358/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:13.797041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.807153 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248be23-7f0c-447d-8476-f410fccc503c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.863235 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd7a5a-50c5-49e5-a2bd-00bc61bc533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.863942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd7a5a-50c5-49e5-a2bd-00bc61bc533b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.864222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd7a5a-50c5-49e5-a2bd-00bc61bc533b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.864498 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd7a5a-50c5-49e5-a2bd-00bc61bc533b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.865213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd7a5a-50c5-49e5-a2bd-00bc61bc533b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.866791 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd7a5a-50c5-49e5-a2bd-00bc61bc533b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.876239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1383/2761] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:13.880450 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:13.891257 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f66e1-78c5-41d3-be4f-e4f68e7c0917 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:13.895943 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:13.896804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.897087 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.897362 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] PATH_INFO: `/v3/projects/3f40e149b1504c4b93abfa3b30175672/users/08ef76003566460eb42b0f77f2593358/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.899384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f40e149b1504c4b93abfa3b30175672, user_id=08ef76003566460eb42b0f77f2593358, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:13.902657 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:13.912507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1379/2762] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:13 2021] PUT /identity/v3/projects/3f40e149b1504c4b93abfa3b30175672/users/08ef76003566460eb42b0f77f2593358/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:13.923284 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dbdb6-e871-439d-ac7b-f01fa1c32e61 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:13.923658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dbdb6-e871-439d-ac7b-f01fa1c32e61 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:13.923942 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dbdb6-e871-439d-ac7b-f01fa1c32e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:13.950643 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-073dbdb6-e871-439d-ac7b-f01fa1c32e61 None None] MFA Rules not processed for user `08ef76003566460eb42b0f77f2593358`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:13.951867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-073dbdb6-e871-439d-ac7b-f01fa1c32e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:14.015380 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1384/2763] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:13 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:14.025878 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:14.027604 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:14.082180 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d9c11-4226-4ea2-a399-2cdee08575d7 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:14.085953 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:14.086582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:14.086869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:14.087187 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:14.141005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:14.142417 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:14.150952 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1380/2764] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:14 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:17.870155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:17.870776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:17.870776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:17.890426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] MFA Rules not processed for user `bf869873369f496e9e25a6d6b2a7ba86`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:17.891901 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:17.948142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1385/2765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:17 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:18.676485 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:18.678019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:18.731827 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:18.747092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bbe6-c745-4841-9d78-59712d6af63e service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:18.752383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:18.753019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:18.753295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:18.753563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:18.755472 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:18.769179 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:18.771841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78e5b-05f8-497a-ae50-f1f923011859 service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:18.785194 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1381/2766] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:18.794906 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431d66b-88cc-439f-8029-7c6aafeac4e1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:18.799743 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:18.800438 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:18.800745 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:18.801106 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] PATH_INFO: `/v3/users/0316c95b0c0845c0a666c1adceaf6385` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:18.802530 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0316c95b0c0845c0a666c1adceaf6385)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:18.804585 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:18.854932 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0316c95b0c0845c0a666c1adceaf6385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:18.871229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0316c95b0c0845c0a666c1adceaf6385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:18.872335 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0316c95b0c0845c0a666c1adceaf6385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:18.884398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0316c95b0c0845c0a666c1adceaf6385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:18.892378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0316c95b0c0845c0a666c1adceaf6385'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:18.898853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1386/2767] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:18 2021] DELETE /identity/v3/users/0316c95b0c0845c0a666c1adceaf6385 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:18.903935 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:18.904314 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:18.904674 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:18.923007 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:18.924208 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:18.983625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1382/2768] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:18.994893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:18.996554 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:19.058238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054657a-0e3a-4b9b-be41-eb18047a29e6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:19.062182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:19.062877 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:19.063188 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:19.063476 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:19.073651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:19.075096 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:19.084666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1387/2769] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:19.347845 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:19.349346 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:19.367378 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0781-1204-4d1c-8fcf-626ea3b237a8 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:19.374440 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:19.375371 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:19.375656 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:19.375930 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] PATH_INFO: `/v3/projects/76b0f7c6711343ae8b26e45a9e0a2ef9` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:19.377404 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b0f7c6711343ae8b26e45a9e0a2ef9)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:19.379430 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:19.425537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b0f7c6711343ae8b26e45a9e0a2ef9', 'request_id': 'req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.431496 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b0f7c6711343ae8b26e45a9e0a2ef9', 'request_id': 'req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.438273 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b0f7c6711343ae8b26e45a9e0a2ef9', 'request_id': 'req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.448163 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] The token cache is being invalidate because project 76b0f7c6711343ae8b26e45a9e0a2ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:19.448444 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.449155 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.450677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1383/2770] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:19 2021] DELETE /identity/v3/projects/76b0f7c6711343ae8b26e45a9e0a2ef9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:19.454614 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:19.464557 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af390f-f5be-45f5-8fe8-6a7c634be361 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:19.519710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:19.520479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:19.520755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:19.521026 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] PATH_INFO: `/v3/users/08ef76003566460eb42b0f77f2593358` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:19.522193 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ef76003566460eb42b0f77f2593358)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:19.524105 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:19.566823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ef76003566460eb42b0f77f2593358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.573287 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ef76003566460eb42b0f77f2593358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.573955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ef76003566460eb42b0f77f2593358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.584849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ef76003566460eb42b0f77f2593358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.592068 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ef76003566460eb42b0f77f2593358'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:19.597765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1388/2771] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:19 2021] DELETE /identity/v3/users/08ef76003566460eb42b0f77f2593358 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:19.896555 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:19.898004 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:19.913709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc70a-c7a4-4b07-bc56-1a86c92fc229 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:19.936992 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:19.938998 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.007177 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.008108 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.008392 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.008668 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] PATH_INFO: `/v3/users/1b015fa36e4b4045af605d1053190588` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.010587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b015fa36e4b4045af605d1053190588)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.013016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.013391 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710185fc-5490-489c-90af-a757498e4354 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.018279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.019161 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.019445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.019724 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] PATH_INFO: `/v3/projects/3f40e149b1504c4b93abfa3b30175672` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.020955 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f40e149b1504c4b93abfa3b30175672)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.022867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.066423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b015fa36e4b4045af605d1053190588'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.067151 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b015fa36e4b4045af605d1053190588'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.073898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f40e149b1504c4b93abfa3b30175672', 'request_id': 'req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.080113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b015fa36e4b4045af605d1053190588'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.080507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f40e149b1504c4b93abfa3b30175672', 'request_id': 'req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.080817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b015fa36e4b4045af605d1053190588'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.089540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-9caa76d4-2599-4842-8901-259d80ac5270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b015fa36e4b4045af605d1053190588'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.092463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f40e149b1504c4b93abfa3b30175672', 'request_id': 'req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.103706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1384/2772] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:19 2021] DELETE /identity/v3/users/1b015fa36e4b4045af605d1053190588 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:20.104552 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] The token cache is being invalidate because project 3f40e149b1504c4b93abfa3b30175672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:20.105009 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.106131 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6bec63b3-81d9-4fb3-927b-c7a43067d0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.108133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1389/2773] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:19 2021] DELETE /identity/v3/projects/3f40e149b1504c4b93abfa3b30175672 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:20.108274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.108621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.108889 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.113737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469b03-1c27-4932-9a57-e010410e56b1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.114224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469b03-1c27-4932-9a57-e010410e56b1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.114679 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469b03-1c27-4932-9a57-e010410e56b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.127390 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:20.128926 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.135683 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-57469b03-1c27-4932-9a57-e010410e56b1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:20.136873 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-57469b03-1c27-4932-9a57-e010410e56b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.188912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1385/2774] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:20.199679 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.201116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.209313 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1390/2775] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:20.211331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.211331 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.211528 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.229869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:20.231227 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.240779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1391/2776] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:20.245412 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.254564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099068e-ccad-41a4-bcff-3e3066b8f0c1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.260815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.261473 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.261755 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.262030 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.262767 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:20.263107 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.263531 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277a603-c3fc-42bc-ae14-63b04a4039ba None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.264702 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.267804 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.268449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.268741 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.269053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.276866 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1392/2777] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 14 03:26:20.279637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.281244 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.281561 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.292275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1386/2778] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:26:20.293829 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715870-7358-4464-8734-cc11125d8fba admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.299319 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.299995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.300300 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.300579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.301279 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.303470 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.339661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1393/2779] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:20.341022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.352359 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a177d-f26c-4139-b147-d7a700584de4 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.433109 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.433790 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.434093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.434406 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] PATH_INFO: `/v3/users` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.435200 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.437331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.471190 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1387/2780] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:20.472783 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.485579 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569d17f-5cb2-4280-b9b7-cacd41bee97e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.493155 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.494857 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.495389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.495870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.496867 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.498780 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.517863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1394/2781] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:20.519158 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.530754 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272ee41-dfe4-4f4e-9373-ba2bd9042fcb admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.538041 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938f9aa-087e-4f87-b992-3c613722c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.539614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938f9aa-087e-4f87-b992-3c613722c414 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.539950 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938f9aa-087e-4f87-b992-3c613722c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.541003 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938f9aa-087e-4f87-b992-3c613722c414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.542216 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938f9aa-087e-4f87-b992-3c613722c414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.548697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938f9aa-087e-4f87-b992-3c613722c414 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.565609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1388/2782] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:26:20.570008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.586394 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1254c-fcaa-4864-ba1e-bc5f25b04eff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.595784 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.596690 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.596974 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.597884 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] PATH_INFO: `/v3/projects/7713b95b2aef44ef856f9a6e25c88988/users/c8619b668e994320ba62e46dd8c5aa0f/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.627348 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7713b95b2aef44ef856f9a6e25c88988, user_id=c8619b668e994320ba62e46dd8c5aa0f, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.632512 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.658922 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1395/2783] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:20 2021] PUT /identity/v3/projects/7713b95b2aef44ef856f9a6e25c88988/users/c8619b668e994320ba62e46dd8c5aa0f/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:20.678482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.678779 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.679093 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.689701 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.697934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.731539 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] MFA Rules not processed for user `c8619b668e994320ba62e46dd8c5aa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:20.732777 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.796019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef1fd2-7550-41d5-9144-485e63c38a8c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.802474 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:20.803463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.803821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.804192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] PATH_INFO: `/v3/projects/4057172f9d694e73b6ed7459c85ada30` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.806529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4057172f9d694e73b6ed7459c85ada30)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:20.808307 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:20.823600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1389/2784] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:20.836283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:20.838455 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:20.899229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4057172f9d694e73b6ed7459c85ada30', 'request_id': 'req-a97fcc22-ee4c-4e08-ae22-9f68463db261'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.912034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4057172f9d694e73b6ed7459c85ada30', 'request_id': 'req-a97fcc22-ee4c-4e08-ae22-9f68463db261'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.923832 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4057172f9d694e73b6ed7459c85ada30', 'request_id': 'req-a97fcc22-ee4c-4e08-ae22-9f68463db261'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.927030 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9278-9d70-4b1b-8411-db92cbb33124 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:20.939407 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] The token cache is being invalidate because project 4057172f9d694e73b6ed7459c85ada30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:20.940269 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.941219 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a97fcc22-ee4c-4e08-ae22-9f68463db261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:20.943110 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1396/2785] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:20 2021] DELETE /identity/v3/projects/4057172f9d694e73b6ed7459c85ada30 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:20.948904 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641612ae-6497-40b2-8d2e-2236414ee0a5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:20.949326 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641612ae-6497-40b2-8d2e-2236414ee0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:20.950061 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641612ae-6497-40b2-8d2e-2236414ee0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:20.972604 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-641612ae-6497-40b2-8d2e-2236414ee0a5 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:20.974341 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-641612ae-6497-40b2-8d2e-2236414ee0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:21.001815 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.003251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.003665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.004033 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.007229 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:21.058371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1397/2786] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:21.065712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.066088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.066428 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.089533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:21.089839 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.090919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:21.091332 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.099297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1398/2787] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:21.103787 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.104419 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1390/2788] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:20 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:21.116882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ac492-091c-44a8-ac87-23f78b253c07 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.122603 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.123315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.123704 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.124139 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.124880 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:21.125186 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.126828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.144146 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1399/2789] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:26:21.148894 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.161615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d8d9-789c-4482-9015-23f70b590282 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.167482 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.168471 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.168756 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.169031 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.169899 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.171858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.207008 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1391/2790] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:21 2021] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:21.213175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.226533 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee1e3a-2228-4ad7-a797-03cc259b511e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.309517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.311117 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.311676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.312264 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.313406 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.315618 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.346070 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1400/2791] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:21 2021] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:21.349826 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.361085 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90637-2f8e-4446-ad91-32c08fa0375b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.367941 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.368734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.369027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.369307 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.370377 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.371898 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.389495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1392/2792] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 14 03:26:21.393494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.407996 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7467-7a0a-47b1-bd9d-d84dbf9337b9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.416205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b4d3-cb21-4894-9e1a-751abbef6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.416938 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b4d3-cb21-4894-9e1a-751abbef6f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.417225 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b4d3-cb21-4894-9e1a-751abbef6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.417879 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b4d3-cb21-4894-9e1a-751abbef6f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.418976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b4d3-cb21-4894-9e1a-751abbef6f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.421808 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b4d3-cb21-4894-9e1a-751abbef6f36 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.454418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1401/2793] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:21.461915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.484019 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27d08-0c5f-4e31-885f-a2e9b7e0acd4 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.496452 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.497698 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.498088 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.498473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] PATH_INFO: `/v3/projects/91749ecdde8e40149e586e80f10bcc8f/users/b4a621f447a0463cb1491e01c0053020/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.530080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=91749ecdde8e40149e586e80f10bcc8f, user_id=b4a621f447a0463cb1491e01c0053020, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.532983 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.551772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1393/2794] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:21 2021] PUT /identity/v3/projects/91749ecdde8e40149e586e80f10bcc8f/users/b4a621f447a0463cb1491e01c0053020/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:21.562712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.562985 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.563320 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.595959 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] MFA Rules not processed for user `b4a621f447a0463cb1491e01c0053020`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:21.597334 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:21.667510 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1402/2795] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:21.673517 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.739611 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb1406-035f-4d49-ab70-f8d346dc4bfe admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.744617 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.745275 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.745563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.745841 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.746582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.748525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.777846 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1394/2796] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:21 2021] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:21.779231 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.789617 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68acb32-1e1c-4cbe-b316-2d9fc1ab6668 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.845396 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.846367 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.846647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.846923 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.847670 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.849573 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.869608 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1403/2797] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:21 2021] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:21.880321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.893347 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9f2b-f03a-4109-979e-13becc967829 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.898038 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.898720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.899002 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.899322 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.900600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.902223 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.912016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1395/2798] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:21.916560 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.926506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5787-8398-4a3e-8765-f64a7fdb7e2b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.931265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6161-8433-452b-8d89-ebe1b1ce8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.931914 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6161-8433-452b-8d89-ebe1b1ce8b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.932204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6161-8433-452b-8d89-ebe1b1ce8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.932479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6161-8433-452b-8d89-ebe1b1ce8b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.933238 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6161-8433-452b-8d89-ebe1b1ce8b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.934849 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6161-8433-452b-8d89-ebe1b1ce8b9e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.944770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1404/2799] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:21.949449 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:21.959345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad26345-3a44-4a61-9efb-5738e0a2b2ba admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:21.964600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:21.965518 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:21.965812 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:21.966236 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] PATH_INFO: `/v3/projects/c6d68715f382424992958eff49682d0e/users/f857ed5f6e8b4ef3a654b79106caeb95/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:21.981451 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d68715f382424992958eff49682d0e, user_id=f857ed5f6e8b4ef3a654b79106caeb95, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:21.984113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:21.999192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1396/2800] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:21 2021] PUT /identity/v3/projects/c6d68715f382424992958eff49682d0e/users/f857ed5f6e8b4ef3a654b79106caeb95/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:22.009525 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.009818 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.010087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.043424 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] MFA Rules not processed for user `f857ed5f6e8b4ef3a654b79106caeb95`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:22.044749 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:22.115524 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1405/2801] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:22.116665 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.188566 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd293f-b079-45a7-a1ef-b72ef9d9d441 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.194199 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.194858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.195364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.195644 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.196368 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.198283 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.234672 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1397/2802] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:22 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:22.240742 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.251800 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6e0c-86bc-4c5a-8377-da61e901caff None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.305823 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.306995 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.307304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.307574 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.308276 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.310178 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.332695 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1406/2803] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:22 2021] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:22.333978 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.344708 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4080-35c9-4a80-b568-84cbf702af6d admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.349383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.350032 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.350318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.350594 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.351478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.353502 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.364150 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1398/2804] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:22.368280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.378019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e21fc-9ee8-4fda-be4a-0ea5d6b8e1ff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.382671 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.383572 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.383862 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.384133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] PATH_INFO: `/v3/projects/b852077b70604a0e8c91b9a4545d710b/users/1a558ca74d294d118ccbde3dc765c4a0/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.398678 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b852077b70604a0e8c91b9a4545d710b, user_id=1a558ca74d294d118ccbde3dc765c4a0, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.401776 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.415821 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1407/2805] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:22 2021] PUT /identity/v3/projects/b852077b70604a0e8c91b9a4545d710b/users/1a558ca74d294d118ccbde3dc765c4a0/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:22.419710 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.429811 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7f259-ea31-4210-8531-a290b472d0c2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.484632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6545db-86c0-434d-8f0b-993f14579af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.485285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6545db-86c0-434d-8f0b-993f14579af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.485567 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6545db-86c0-434d-8f0b-993f14579af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.485844 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6545db-86c0-434d-8f0b-993f14579af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.486565 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6545db-86c0-434d-8f0b-993f14579af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.488483 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6545db-86c0-434d-8f0b-993f14579af7 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.497798 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1399/2806] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:22 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:22.501825 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.511882 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d950-8ab4-4792-bf29-0664c54f4bfe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.516518 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.517378 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.517662 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.517935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] PATH_INFO: `/v3/projects/b852077b70604a0e8c91b9a4545d710b/users/1a558ca74d294d118ccbde3dc765c4a0/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.519951 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b852077b70604a0e8c91b9a4545d710b, user_id=1a558ca74d294d118ccbde3dc765c4a0, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.522546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.533371 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1408/2807] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:22 2021] PUT /identity/v3/projects/b852077b70604a0e8c91b9a4545d710b/users/1a558ca74d294d118ccbde3dc765c4a0/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:22.544486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.544690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.544974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.570680 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] MFA Rules not processed for user `1a558ca74d294d118ccbde3dc765c4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:22.572304 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:22.641133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1400/2808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:22 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:22.652772 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:22.654226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:22.727022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f5c5-153d-4381-b14a-e6bfe1378751 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:22.731213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:22.731891 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:22.732173 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:22.732445 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:22.790506 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:22.792172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:22.800982 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1409/2809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:22 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:26:24.183598 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:24.185061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:24.247654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e968f-0bed-4e1a-b714-7ce62bf7e9df None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:24.252394 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:24.253249 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:24.253557 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:24.253828 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] PATH_INFO: `/v3/users/c8619b668e994320ba62e46dd8c5aa0f` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:24.256157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8619b668e994320ba62e46dd8c5aa0f)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:24.258071 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:24.261729 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:24.263213 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:24.274044 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02814141-6adc-4c39-b076-f6d1554874fc service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:24.278232 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:24.278851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:24.279167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:24.279439 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:24.303266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8619b668e994320ba62e46dd8c5aa0f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.303911 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8619b668e994320ba62e46dd8c5aa0f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.315182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8619b668e994320ba62e46dd8c5aa0f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.315876 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8619b668e994320ba62e46dd8c5aa0f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.324409 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-c9cf4333-b3e3-4c0a-80c3-fea875b48e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8619b668e994320ba62e46dd8c5aa0f'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.335833 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:24.336463 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1401/2810] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:24 2021] DELETE /identity/v3/users/c8619b668e994320ba62e46dd8c5aa0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:24.339841 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:24.341488 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:24.341916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:24.342182 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:24.349123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1410/2811] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:26:24.359560 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:24.360764 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:24.419374 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1402/2812] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:24.429437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:24.432710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:24.495915 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6df62b-86cb-4a29-855f-6db84aaebbe6 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:24.545274 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:24.546234 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:24.546379 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:24.546653 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:24.557687 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:24.559345 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:24.569291 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1411/2813] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:26:24.852098 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:24.853397 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:24.866120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8b61-0b04-4625-9d49-cbd5a58eb791 None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:24.871916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:24.872962 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:24.873089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:24.873842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] PATH_INFO: `/v3/projects/7713b95b2aef44ef856f9a6e25c88988` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:24.875218 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7713b95b2aef44ef856f9a6e25c88988)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:24.877605 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:24.910845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:24.912268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:24.926116 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7713b95b2aef44ef856f9a6e25c88988', 'request_id': 'req-d9925f5b-5926-4b17-a0c6-0a06d4b95798'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.933361 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7713b95b2aef44ef856f9a6e25c88988', 'request_id': 'req-d9925f5b-5926-4b17-a0c6-0a06d4b95798'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.940831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7713b95b2aef44ef856f9a6e25c88988', 'request_id': 'req-d9925f5b-5926-4b17-a0c6-0a06d4b95798'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.951459 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] The token cache is being invalidate because project 7713b95b2aef44ef856f9a6e25c88988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:24.951768 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.952412 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-d9925f5b-5926-4b17-a0c6-0a06d4b95798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:24.953974 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1403/2814] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:24 2021] DELETE /identity/v3/projects/7713b95b2aef44ef856f9a6e25c88988 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:24.959355 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdfd3e-31e2-4493-b95a-12ad647301a8 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:24.959643 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdfd3e-31e2-4493-b95a-12ad647301a8 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:24.959916 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdfd3e-31e2-4493-b95a-12ad647301a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:24.972854 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b707cd-f225-4241-b336-3716f9eea37c service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:24.978901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-9dfdfd3e-31e2-4493-b95a-12ad647301a8 None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:24.980113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-9dfdfd3e-31e2-4493-b95a-12ad647301a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:25.021082 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.021758 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.022041 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.022315 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.024240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:25.035868 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1404/2815] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:25.044320 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.044607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.044882 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.062992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:25.064274 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:25.072227 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1405/2816] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:25.076067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.084728 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e3570-1036-4b46-b6e5-c85d2d9ee50d None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.089530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.090198 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.090480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.090755 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.091535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:26:25.091842 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.093480 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.100433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.101853 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.105727 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1406/2817] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:26:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:26:25.109971 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.113152 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1412/2818] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:24 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 14 03:26:25.120143 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffad23-e13f-429a-b5b5-752a30e147c1 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.124840 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.125469 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.125750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.126023 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.126711 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.128614 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.154367 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1407/2819] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:26:25 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:26:25.158538 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.170965 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee0369-7b4e-470a-bdda-bf96ae0d055c service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.229766 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.230419 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.230699 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.230966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.231684 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.233563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.254615 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1413/2820] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:26:25 2021] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:26:25.258992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.269068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634cedd-5b3c-4804-a8a8-49eb7aea0380 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.273726 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.274285 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.274562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.274847 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.275606 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.277181 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.286793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1408/2821] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:25 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:25.291136 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.300834 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cdcd9-83d2-4188-9bd0-a8fe5c31b725 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.305358 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17def9d-409f-49c5-8c80-fe9da4ce2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.306587 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17def9d-409f-49c5-8c80-fe9da4ce2695 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.306874 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17def9d-409f-49c5-8c80-fe9da4ce2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.307283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17def9d-409f-49c5-8c80-fe9da4ce2695 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.308038 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17def9d-409f-49c5-8c80-fe9da4ce2695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.309589 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17def9d-409f-49c5-8c80-fe9da4ce2695 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.319170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1414/2822] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:26:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:26:25.323000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.332697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee01e5-d808-4080-8d2b-e8a4cf12ad19 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.337316 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.338748 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.339065 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.339335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] PATH_INFO: `/v3/projects/78c0550396bb4156a986650fecac5f28/users/ad04f99c1d074f4caae90b0e579ac8cd/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.354092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c0550396bb4156a986650fecac5f28, user_id=ad04f99c1d074f4caae90b0e579ac8cd, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.356744 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.370893 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1409/2823] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:26:25 2021] PUT /identity/v3/projects/78c0550396bb4156a986650fecac5f28/users/ad04f99c1d074f4caae90b0e579ac8cd/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:25.376268 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1251de-bcc9-4390-8c68-b7d929e4377f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.376665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1251de-bcc9-4390-8c68-b7d929e4377f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.377045 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1251de-bcc9-4390-8c68-b7d929e4377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.394863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-db1251de-bcc9-4390-8c68-b7d929e4377f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:25.396115 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-db1251de-bcc9-4390-8c68-b7d929e4377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:25.454024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1415/2824] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:25.464386 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:25.466117 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:25.520592 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377644b-dd33-444c-882a-2f657385ef9e admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:25.524233 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:25.524799 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:25.525124 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:25.525399 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:25.534084 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:25.535540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:25.544633 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1410/2825] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:26.211898 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253066d-1bd7-485b-8c75-82143cf48e32 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:26.212214 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253066d-1bd7-485b-8c75-82143cf48e32 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:26.212492 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253066d-1bd7-485b-8c75-82143cf48e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:26.245245 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e253066d-1bd7-485b-8c75-82143cf48e32 None None] MFA Rules not processed for user `ad04f99c1d074f4caae90b0e579ac8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:26.246482 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e253066d-1bd7-485b-8c75-82143cf48e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:26.313976 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1416/2826] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:26 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:26:26.324295 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:26.326251 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:26.386000 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069718-a0f4-40fc-ad85-d52e89c4328a service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:26.391464 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:26.392120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:26.392402 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:26.392677 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:26.401723 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:26.403197 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:26.412796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1411/2827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:26 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:27.758508 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e80cc-f732-42d8-85cc-dc817bfbb748 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:27.758969 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e80cc-f732-42d8-85cc-dc817bfbb748 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:27.759093 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e80cc-f732-42d8-85cc-dc817bfbb748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:27.776948 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-948e80cc-f732-42d8-85cc-dc817bfbb748 None None] MFA Rules not processed for user `ad04f99c1d074f4caae90b0e579ac8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:27.778142 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-948e80cc-f732-42d8-85cc-dc817bfbb748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:27.786321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1417/2828] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:27 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:28.918690 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:28.920100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:28.933917 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ddac-9dfa-468b-9a60-418fbdd3d143 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:28.938653 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:28.939537 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:28.939820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:28.940096 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] PATH_INFO: `/v3/users/b4a621f447a0463cb1491e01c0053020` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:28.941334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a621f447a0463cb1491e01c0053020)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:28.943277 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:28.988542 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a621f447a0463cb1491e01c0053020'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:28.989201 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a621f447a0463cb1491e01c0053020'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.000615 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a621f447a0463cb1491e01c0053020'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.001303 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a621f447a0463cb1491e01c0053020'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.008504 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a621f447a0463cb1491e01c0053020'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.021005 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1412/2829] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:28 2021] DELETE /identity/v3/users/b4a621f447a0463cb1491e01c0053020 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:29.026124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:29.026597 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:29.026694 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:29.044732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:29.045935 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:29.109908 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1418/2830] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:29.120335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:29.121720 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:29.175639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befda818-2626-43bb-9701-8c6ab97f5401 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:29.179339 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:29.179976 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:29.180259 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:29.180534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:29.190156 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:29.191631 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:29.201357 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1413/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:29.572162 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:29.574308 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:29.588069 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878ba4a-aec6-4b09-a8eb-fec471de7a3b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:29.593008 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:29.594229 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:29.594611 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:29.595076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] PATH_INFO: `/v3/projects/91749ecdde8e40149e586e80f10bcc8f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:29.596750 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91749ecdde8e40149e586e80f10bcc8f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:29.599265 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:29.646500 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91749ecdde8e40149e586e80f10bcc8f', 'request_id': 'req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.652802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91749ecdde8e40149e586e80f10bcc8f', 'request_id': 'req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.661410 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91749ecdde8e40149e586e80f10bcc8f', 'request_id': 'req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.672576 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] The token cache is being invalidate because project 91749ecdde8e40149e586e80f10bcc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:29.672868 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.673542 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.675236 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1419/2832] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:29 2021] DELETE /identity/v3/projects/91749ecdde8e40149e586e80f10bcc8f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:29.679571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:29.689993 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d69dd-bb16-42b1-b119-58a9f21e90f7 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:29.747467 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:29.748325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:29.748600 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:29.748872 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] PATH_INFO: `/v3/users/f857ed5f6e8b4ef3a654b79106caeb95` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:29.750067 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f857ed5f6e8b4ef3a654b79106caeb95)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:29.752022 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:29.797734 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f857ed5f6e8b4ef3a654b79106caeb95'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.798400 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f857ed5f6e8b4ef3a654b79106caeb95'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.810700 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f857ed5f6e8b4ef3a654b79106caeb95'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.811383 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f857ed5f6e8b4ef3a654b79106caeb95'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.819729 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f857ed5f6e8b4ef3a654b79106caeb95'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:29.832585 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1414/2833] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:29 2021] DELETE /identity/v3/users/f857ed5f6e8b4ef3a654b79106caeb95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:30.094851 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:30.096333 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:30.110710 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f96b-ee72-4c15-8f15-ff23f8a0048c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:30.168532 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:30.169400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:30.169765 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:30.170003 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] PATH_INFO: `/v3/projects/c6d68715f382424992958eff49682d0e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:30.171316 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d68715f382424992958eff49682d0e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:30.173272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:30.221398 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d68715f382424992958eff49682d0e', 'request_id': 'req-2e3953df-f714-4549-a2b5-c5de4b71c70b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.227332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d68715f382424992958eff49682d0e', 'request_id': 'req-2e3953df-f714-4549-a2b5-c5de4b71c70b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.236159 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d68715f382424992958eff49682d0e', 'request_id': 'req-2e3953df-f714-4549-a2b5-c5de4b71c70b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.247491 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] The token cache is being invalidate because project c6d68715f382424992958eff49682d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:30.247779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.248437 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.249967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1420/2834] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:30 2021] DELETE /identity/v3/projects/c6d68715f382424992958eff49682d0e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:26:30.253977 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:30.255486 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:30.267855 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026bb69-44c4-4dff-a749-9d29ca6f7e5f admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:30.322321 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:30.323217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:30.323498 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:30.323772 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] PATH_INFO: `/v3/users/1a558ca74d294d118ccbde3dc765c4a0` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:30.324991 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a558ca74d294d118ccbde3dc765c4a0)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:30.326915 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:30.375380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a558ca74d294d118ccbde3dc765c4a0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.376178 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a558ca74d294d118ccbde3dc765c4a0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.389437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a558ca74d294d118ccbde3dc765c4a0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.390195 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a558ca74d294d118ccbde3dc765c4a0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.401632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a558ca74d294d118ccbde3dc765c4a0'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:30.415293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1415/2835] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:26:30 2021] DELETE /identity/v3/users/1a558ca74d294d118ccbde3dc765c4a0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:30.882002 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:30.883741 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:30.897224 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3953df-f714-4549-a2b5-c5de4b71c70b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:30.960887 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:30.961864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:30.962222 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:30.963204 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] PATH_INFO: `/v3/projects/b852077b70604a0e8c91b9a4545d710b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:30.964507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b852077b70604a0e8c91b9a4545d710b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:30.966652 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:31.016651 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b852077b70604a0e8c91b9a4545d710b', 'request_id': 'req-817d51a2-339a-44c3-ae54-5ee63646d2d2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:31.023102 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b852077b70604a0e8c91b9a4545d710b', 'request_id': 'req-817d51a2-339a-44c3-ae54-5ee63646d2d2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:31.032494 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b852077b70604a0e8c91b9a4545d710b', 'request_id': 'req-817d51a2-339a-44c3-ae54-5ee63646d2d2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:31.047658 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] The token cache is being invalidate because project b852077b70604a0e8c91b9a4545d710b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:26:31.048125 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:31.048984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-817d51a2-339a-44c3-ae54-5ee63646d2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:26:31.051426 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1421/2836] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:26:30 2021] DELETE /identity/v3/projects/b852077b70604a0e8c91b9a4545d710b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:26:32.870348 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:32.872142 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:32.944388 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3224-235d-4333-93fa-29fa409a7039 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:33.004705 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:33.005344 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:33.005628 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:33.005904 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:33.007681 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:33.019721 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:33.021301 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:33.031553 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1416/2837] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:26:43.666088 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6571-b8ff-45f9-b0e0-f635ddcf5f05 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:43.666606 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6571-b8ff-45f9-b0e0-f635ddcf5f05 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:43.666712 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6571-b8ff-45f9-b0e0-f635ddcf5f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:43.683979 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d05f6571-b8ff-45f9-b0e0-f635ddcf5f05 None None] MFA Rules not processed for user `ad04f99c1d074f4caae90b0e579ac8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:26:43.685181 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d05f6571-b8ff-45f9-b0e0-f635ddcf5f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:43.737946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1422/2838] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:26:43 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:26:43.961864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:26:43.963478 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:44.017366 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236b75-d7ae-43e5-ba9f-1c16f43ff82c service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:26:44.020921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:26:44.021540 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:26:44.021817 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:26:44.022086 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:26:44.023820 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:26:44.033331 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:26:44.034739 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:26:44.043062 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1417/2839] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:26:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:27:04.859578 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4801b-fc4b-41ef-96c2-cc2eb026c371 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:04.860050 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4801b-fc4b-41ef-96c2-cc2eb026c371 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:04.860170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4801b-fc4b-41ef-96c2-cc2eb026c371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:04.878786 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-26d4801b-fc4b-41ef-96c2-cc2eb026c371 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:04.880011 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-26d4801b-fc4b-41ef-96c2-cc2eb026c371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:04.932869 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1423/2840] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Dec 14 03:27:04 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:27:04.977370 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:04.979442 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:05.045632 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bf4bf-4293-4cb0-9d12-e5ec5b437a75 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:05.050587 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:05.051245 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:05.051530 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:05.051807 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:05.060437 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:05.061999 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:05.069784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1418/2841] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:27:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:27:20.204034 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:20.204529 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:20.204631 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:20.222058 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] MFA Rules not processed for user `f9a2e0f788614fe98b7e1d430d473a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:20.223270 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:20.230586 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1424/2842] 10.222.0.43 () {58 vars in 967 bytes} [Tue Dec 14 03:27:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:27:20.243724 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:20.253853 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2536e-3e95-4837-9591-0d2cc50e4e52 service swift] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:20.259405 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8abbf99271a142d0b6b33194845916aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:20.260021 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:20.260300 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:20.260572 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:20.268364 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:20.269920 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:20.277654 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1419/2843] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Dec 14 03:27:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 14 03:27:22.126507 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.128133 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:22.193613 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d66820-dbe4-49d7-ac29-9c1bdf2e3c49 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.197997 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.198846 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.199154 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.199429 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] PATH_INFO: `/v3/users/ad04f99c1d074f4caae90b0e579ac8cd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.200626 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad04f99c1d074f4caae90b0e579ac8cd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.202513 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.246282 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad04f99c1d074f4caae90b0e579ac8cd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.252746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad04f99c1d074f4caae90b0e579ac8cd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.253389 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad04f99c1d074f4caae90b0e579ac8cd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.264357 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad04f99c1d074f4caae90b0e579ac8cd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.271447 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c8bd803c-c8cd-4dc1-824f-94dc76b2e5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad04f99c1d074f4caae90b0e579ac8cd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.277327 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1425/2844] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:27:22 2021] DELETE /identity/v3/users/ad04f99c1d074f4caae90b0e579ac8cd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:27:22.439955 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.450443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca4778-61f2-4c48-bf0d-cde164ad8f51 service swift] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.506796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.507676 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.507958 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.508232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] PATH_INFO: `/v3/projects/78c0550396bb4156a986650fecac5f28` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.509443 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c0550396bb4156a986650fecac5f28)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.511381 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.555550 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c0550396bb4156a986650fecac5f28', 'request_id': 'req-ece64883-876c-4616-85ca-f2a1cdbed51e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.561429 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c0550396bb4156a986650fecac5f28', 'request_id': 'req-ece64883-876c-4616-85ca-f2a1cdbed51e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.568571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c0550396bb4156a986650fecac5f28', 'request_id': 'req-ece64883-876c-4616-85ca-f2a1cdbed51e'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.578641 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] The token cache is being invalidate because project 78c0550396bb4156a986650fecac5f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:27:22.578949 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.579613 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ece64883-876c-4616-85ca-f2a1cdbed51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:27:22.581113 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1420/2845] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:27:22 2021] DELETE /identity/v3/projects/78c0550396bb4156a986650fecac5f28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:27:22.587336 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.587625 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.587902 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.606132 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:22.607397 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:22.665936 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1426/2846] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:27:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:27:22.673901 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.674519 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.674796 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.692998 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:22.694184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:22.702625 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1421/2847] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:27:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:27:22.706896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.716919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09e276-4b91-4add-8aa3-d409b9f4c6df None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.721666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.722303 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.722607 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.722876 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.723645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 14 03:27:22.723947 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.725515 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.737486 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1427/2848] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Dec 14 03:27:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 14 03:27:22.742092 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.751221 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb02e27-e734-4d63-887c-e56d13567a6f None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.755871 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.756512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.756793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.757089 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.757792 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.760345 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.784563 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1422/2849] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:27:22 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 14 03:27:22.788591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.798257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55eb37-dd93-4595-aebe-f775a3821a39 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.852192 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.852889 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.853170 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.853443 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.854129 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.856054 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.874872 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1428/2850] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:27:22 2021] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:27:22.878869 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.889528 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d9da-bbe3-48aa-87ec-d58006439d71 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.894120 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.894759 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.895064 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.895337 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.896066 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.897635 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.908534 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1423/2851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:27:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:27:22.912845 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.922864 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd06f61-c08b-4ff0-9fd9-c9355d46bbda admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.927633 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9336396-4c5e-41ec-9b00-1635e7ed78fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.928280 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336396-4c5e-41ec-9b00-1635e7ed78fd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.928564 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336396-4c5e-41ec-9b00-1635e7ed78fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.928838 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336396-4c5e-41ec-9b00-1635e7ed78fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.929756 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336396-4c5e-41ec-9b00-1635e7ed78fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.931395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336396-4c5e-41ec-9b00-1635e7ed78fd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.940943 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1429/2852] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:27:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:27:22.945014 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:22.955317 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e48f-9868-40b5-bd8a-94fef2ef8006 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:22.959861 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:22.960714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] REQUEST_METHOD: `PUT` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.960994 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.961270 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] PATH_INFO: `/v3/projects/84ffd96b68cf41c5a9be418ed8c0c61a/users/a82d0b9a044e43fba9a353b54b74c680/roles/087c457f13d74023b2c0f38de56ab52c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:22.975697 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ffd96b68cf41c5a9be418ed8c0c61a, user_id=a82d0b9a044e43fba9a353b54b74c680, role_id=087c457f13d74023b2c0f38de56ab52c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:22.978302 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:22.991510 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1424/2853] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:27:22 2021] PUT /identity/v3/projects/84ffd96b68cf41c5a9be418ed8c0c61a/users/a82d0b9a044e43fba9a353b54b74c680/roles/087c457f13d74023b2c0f38de56ab52c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:27:22.996591 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00c62-1703-43f0-b9a9-0159dce2f83a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:22.996875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00c62-1703-43f0-b9a9-0159dce2f83a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:22.997177 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00c62-1703-43f0-b9a9-0159dce2f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:23.014598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-edd00c62-1703-43f0-b9a9-0159dce2f83a None None] MFA Rules not processed for user `a56319b0d4c140e5b834fcb4b4fa313b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:23.015812 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-edd00c62-1703-43f0-b9a9-0159dce2f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:23.070764 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1430/2854] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:27:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 14 03:27:23.081214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:23.082921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:23.137782 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1238-dd88-4465-9cfe-d01afec9a65c admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:23.141658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:23.142293 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:23.142596 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:23.142858 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:23.151992 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:23.153415 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:23.162624 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1425/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:27:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:27:26.965563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:26.966039 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:26.966248 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:26.992450 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] MFA Rules not processed for user `a82d0b9a044e43fba9a353b54b74c680`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:26.993583 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:27.056779 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1431/2856] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:27:26 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:27:27.061074 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:27.070757 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae636b54-e80e-43a1-9ed7-7982172c7d72 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:27.075441 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:27.076075 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:27.076356 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:27.076629 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:27.077334 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:27.079262 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:27.107080 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1426/2857] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Dec 14 03:27:27 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:27:27.110111 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:27.124666 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd56c-e2c7-4b31-8ee7-44ae71f0e158 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:27.181123 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:27.181815 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:27.182124 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:27.182418 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:27.183164 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:27.185119 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:27.205584 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1432/2858] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Dec 14 03:27:27 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 14 03:27:27.209479 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:27.220341 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d8f26-cf4b-4235-a2b0-598d0fb04ce2 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:27.224937 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:27.225582 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:27.225860 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:27.226128 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:27.226848 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:27.228481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:27.239396 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1427/2859] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:27:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:27:27.243639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:27.253638 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3923ea-8735-424d-8edd-8b91627d2729 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:27.259158 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:27.259984 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:27.260266 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:27.260539 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] PATH_INFO: `/v3/projects/32ff09be74fb44fa9cd1bba92f63f7d6/users/e9aaabb2094e41378c9ba4358869fe83/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:27.277644 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ff09be74fb44fa9cd1bba92f63f7d6, user_id=e9aaabb2094e41378c9ba4358869fe83, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:27.280411 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:27.304171 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1433/2860] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:27:27 2021] PUT /identity/v3/projects/32ff09be74fb44fa9cd1bba92f63f7d6/users/e9aaabb2094e41378c9ba4358869fe83/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:27:27.308695 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:27.319326 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670b010-6e4e-4faf-81f4-8aee81fa9e5b admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:27.385044 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de23c7-180c-473e-86be-69dc492e7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:27.385702 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de23c7-180c-473e-86be-69dc492e7852 admin admin] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:27.386053 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de23c7-180c-473e-86be-69dc492e7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:27.386235 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de23c7-180c-473e-86be-69dc492e7852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:27.386960 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de23c7-180c-473e-86be-69dc492e7852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:27.388578 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de23c7-180c-473e-86be-69dc492e7852 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:27.398806 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1428/2861] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Dec 14 03:27:27 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 14 03:27:27.403594 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:27.414373 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d5ff-6447-47c5-8db5-e8d84cf5e2a8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:27.419293 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:27.420118 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:27.420395 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:27.420693 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] PATH_INFO: `/v3/projects/32ff09be74fb44fa9cd1bba92f63f7d6/users/e9aaabb2094e41378c9ba4358869fe83/roles/fcf4cbc18cf54532a9afbff30f1453b0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:27.422934 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ff09be74fb44fa9cd1bba92f63f7d6, user_id=e9aaabb2094e41378c9ba4358869fe83, role_id=fcf4cbc18cf54532a9afbff30f1453b0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:27.426024 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:27.437526 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1434/2862] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Dec 14 03:27:27 2021] PUT /identity/v3/projects/32ff09be74fb44fa9cd1bba92f63f7d6/users/e9aaabb2094e41378c9ba4358869fe83/roles/fcf4cbc18cf54532a9afbff30f1453b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:27:31.753913 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839093c4-0760-4b10-91a4-5ab11d4010d1 None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:31.754912 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839093c4-0760-4b10-91a4-5ab11d4010d1 None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:31.755099 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839093c4-0760-4b10-91a4-5ab11d4010d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:31.786291 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-839093c4-0760-4b10-91a4-5ab11d4010d1 None None] MFA Rules not processed for user `e9aaabb2094e41378c9ba4358869fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:31.787875 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-839093c4-0760-4b10-91a4-5ab11d4010d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:31.857232 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1429/2863] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:27:31 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:27:31.864971 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:31.866831 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:31.937802 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56fd79-c24e-4032-a2fe-aee5b309d3e6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:31.943332 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:31.943990 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:31.944272 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:31.944545 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:31.998112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:31.999669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:32.009076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1435/2864] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:27:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:27:33.170867 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] REQUEST_METHOD: `POST` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:33.171384 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:33.171501 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:33.189051 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.auth.core [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] MFA Rules not processed for user `a82d0b9a044e43fba9a353b54b74c680`. Rule list: `[]` (Enabled: `True`). {{(pid=79278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:27:33.190230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:33.197410 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1430/2865] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:27:33 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:27:56.968514 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:27:56.969967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:57.072961 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7761-fc94-4520-8f4b-9cbe106246ea service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:27:57.076828 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:27:57.077463 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:27:57.077746 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:27:57.078022 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:27:57.079817 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:27:57.089774 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:27:57.091324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:27:57.107647 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1436/2866] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:27:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:28:00.221133 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:28:00.223230 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:00.286029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b06887-82ac-4625-9fba-3ae087a7318e None None] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:28:00.293107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:28:00.293849 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:28:00.294319 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:28:00.295380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:28:00.296771 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:00.309805 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:28:00.311477 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:28:00.322970 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1431/2867] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:28:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:28:14.298175 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:28:14.306416 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1086ef4-e61e-4688-b50c-dd5820346e1e service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:28:14.310475 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f0823-1750-4463-aff8-6eaa61df10be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:28:14.311112 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f0823-1750-4463-aff8-6eaa61df10be service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:28:14.311388 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f0823-1750-4463-aff8-6eaa61df10be service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:28:14.311656 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f0823-1750-4463-aff8-6eaa61df10be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:28:14.320169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f0823-1750-4463-aff8-6eaa61df10be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:28:14.321563 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f0823-1750-4463-aff8-6eaa61df10be service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:28:14.331122 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1437/2868] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:28:14 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:28:40.154562 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:28:40.156068 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:40.209473 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac65db-a109-4dec-8597-bf6829bba2cf service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:28:40.213001 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '647e47606fc9438cb580f58fe7daae4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:28:40.213621 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:28:40.214507 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:28:40.214784 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:28:40.216525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:40.271712 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:28:40.273170 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:28:40.282549 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1432/2869] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:28:40 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:28:52.251346 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:28:52.251855 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:28:52.251966 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:28:52.269025 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] MFA Rules not processed for user `bf869873369f496e9e25a6d6b2a7ba86`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 14 03:28:52.270201 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:52.276863 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1438/2870] 10.222.0.43 () {58 vars in 957 bytes} [Tue Dec 14 03:28:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 14 03:28:53.415132 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:28:53.416520 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:53.503535 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030df0-18c0-46fc-87eb-38bdfa27b1b9 service cinder] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:28:53.508599 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:28:53.509231 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:28:53.509514 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:28:53.509793 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:28:53.511620 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:28:53.522669 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:28:53.524266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:28:53.534382 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1433/2871] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:28:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:29:10.732582 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:29:10.742149 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d35e-4f5f-4406-a2f9-82d25c8f391e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:29:10.745881 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:29:10.746522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:29:10.746798 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:29:10.747095 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:29:10.748919 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:29:10.808091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:29:10.809522 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:29:10.818709 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1439/2872] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:29:10 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:30:43.016732 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:30:43.026209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2adfde-22a9-4a23-b66b-0eb98fdf98c9 service placement] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:30:43.029961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:30:43.030658 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:30:43.031027 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:30:43.031328 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:30:43.033077 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:30:43.064824 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:30:43.066246 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:30:43.086214 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1434/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:30:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:30:44.262546 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:30:44.270983 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a545a2-b832-4677-9576-0a10e18c9ea5 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:30:44.274624 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:30:44.275285 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:30:44.276072 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:30:44.276342 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:30:44.278085 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:30:44.290850 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:30:44.292858 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:30:44.303417 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1440/2874] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:30:44 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:30:51.279512 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:30:51.287923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100cfb9-9f0a-496d-8f33-c053d13c8a4e service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:30:51.292212 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:30:51.292829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:30:51.293107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:30:51.293380 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:30:51.295173 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:30:51.304939 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:30:51.306363 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:30:51.314325 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1435/2875] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:30:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:30:57.680249 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:30:57.688730 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be9c41-55db-43d8-abe2-396b66d72520 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:30:57.692420 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:30:57.693043 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:30:57.693324 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:30:57.693598 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:30:57.695400 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:30:57.705661 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:30:57.707098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:30:57.715645 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1441/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:30:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:31:02.897959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:31:02.912269 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1b5d-43b2-4b1c-9a45-7c30dd646476 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:31:02.922029 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d2810610e748859ea9ff10d45190b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:31:02.922961 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:31:02.923466 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:31:02.923944 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:31:02.926100 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:31:02.940118 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:31:02.942037 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:31:02.954423 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1436/2877] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:31:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:31:16.137771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:31:16.146433 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cbd98-5218-4d56-8b60-9eb431342b92 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:31:16.151304 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:31:16.151946 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:31:16.152292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:31:16.152639 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:31:16.154541 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:31:16.235403 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:31:16.236852 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:31:16.254771 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1442/2878] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:31:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:31:22.427333 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:31:22.429495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:31:22.445706 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa28f-a85b-4238-a8ba-abd5915d066f service nova] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:31:22.450864 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:31:22.451769 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:31:22.452054 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:31:22.452330 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] PATH_INFO: `/v3/users/bf869873369f496e9e25a6d6b2a7ba86` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:31:22.453541 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf869873369f496e9e25a6d6b2a7ba86)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:31:22.455623 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:31:22.503666 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf869873369f496e9e25a6d6b2a7ba86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.504313 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf869873369f496e9e25a6d6b2a7ba86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.515481 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf869873369f496e9e25a6d6b2a7ba86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.516107 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf869873369f496e9e25a6d6b2a7ba86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.522959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf869873369f496e9e25a6d6b2a7ba86'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.535258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1437/2879] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:31:22 2021] DELETE /identity/v3/users/bf869873369f496e9e25a6d6b2a7ba86 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:31:22.698875 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:31:22.709900 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ae89-bd3a-408e-a2a5-e6cd007a9072 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:31:22.767676 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:31:22.768520 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:31:22.768801 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:31:22.769076 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] PATH_INFO: `/v3/projects/d0c4dcf4957d42b896f04f682afeef7b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:31:22.770257 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c4dcf4957d42b896f04f682afeef7b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:31:22.772182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:31:22.815813 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c4dcf4957d42b896f04f682afeef7b', 'request_id': 'req-50722786-3dd0-41fe-8d94-d96962a1d241'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.821517 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c4dcf4957d42b896f04f682afeef7b', 'request_id': 'req-50722786-3dd0-41fe-8d94-d96962a1d241'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.829240 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c4dcf4957d42b896f04f682afeef7b', 'request_id': 'req-50722786-3dd0-41fe-8d94-d96962a1d241'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.840275 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] The token cache is being invalidate because project d0c4dcf4957d42b896f04f682afeef7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:31:22.840622 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.841172 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.842899 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1443/2880] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:31:22 2021] DELETE /identity/v3/projects/d0c4dcf4957d42b896f04f682afeef7b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:31:22.846709 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:31:22.848172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:31:22.862266 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ee06b-adf8-4d28-943f-e96128141f36 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:31:22.917159 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:31:22.918009 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:31:22.918296 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:31:22.918571 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] PATH_INFO: `/v3/users/2382b3eb96834b978f018c0bbbc61b5c` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:31:22.919825 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2382b3eb96834b978f018c0bbbc61b5c)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:31:22.921758 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:31:22.968063 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2382b3eb96834b978f018c0bbbc61b5c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.968714 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2382b3eb96834b978f018c0bbbc61b5c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.980130 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2382b3eb96834b978f018c0bbbc61b5c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.980766 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2382b3eb96834b978f018c0bbbc61b5c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.987809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2382b3eb96834b978f018c0bbbc61b5c'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:22.999831 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1438/2881] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:31:22 2021] DELETE /identity/v3/users/2382b3eb96834b978f018c0bbbc61b5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:31:23.166321 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:31:23.167958 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:31:23.181087 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722786-3dd0-41fe-8d94-d96962a1d241 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:31:23.236150 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:31:23.236924 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:31:23.237198 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:31:23.237465 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] PATH_INFO: `/v3/projects/0474e738524046fc9da3b998a6133a0d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:31:23.238737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0474e738524046fc9da3b998a6133a0d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:31:23.240893 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:31:23.284226 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0474e738524046fc9da3b998a6133a0d', 'request_id': 'req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:23.290014 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0474e738524046fc9da3b998a6133a0d', 'request_id': 'req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:23.297091 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0474e738524046fc9da3b998a6133a0d', 'request_id': 'req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:23.307385 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] The token cache is being invalidate because project 0474e738524046fc9da3b998a6133a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:31:23.307667 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:23.308283 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:31:23.310228 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1444/2882] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:31:23 2021] DELETE /identity/v3/projects/0474e738524046fc9da3b998a6133a0d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 14 03:32:41.663309 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:32:41.664738 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:41.718809 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2e851-2f9a-4fc3-9242-ad63c6971e03 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:32:41.764192 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:32:41.764823 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:32:41.765103 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:32:41.765376 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:32:41.767157 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:41.821843 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:32:41.823305 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:32:41.831750 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1439/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:32:41 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:32:46.609098 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:32:46.610637 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:46.623521 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450d724-3d8c-4ce5-a8c2-7471d4b5bed0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:32:46.627079 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f08db48e9814f7db34ffcf7d581fc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:32:46.627737 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:32:46.628019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:32:46.628292 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:32:46.630100 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:46.691870 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:32:46.693297 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:32:46.703289 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1445/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:32:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 14 03:32:52.885168 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:32:52.887184 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:52.903258 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66641503-3ff3-4df0-a21a-cd8c10278642 service neutron] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:32:52.907921 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:32:52.908801 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:32:52.909061 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:32:52.909335 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] PATH_INFO: `/v3/users/a82d0b9a044e43fba9a353b54b74c680` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:32:52.910551 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82d0b9a044e43fba9a353b54b74c680)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:32:52.912495 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:32:52.965114 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82d0b9a044e43fba9a353b54b74c680'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:52.965874 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82d0b9a044e43fba9a353b54b74c680'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:52.981172 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82d0b9a044e43fba9a353b54b74c680'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:52.981923 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82d0b9a044e43fba9a353b54b74c680'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:52.989959 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82d0b9a044e43fba9a353b54b74c680'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.002595 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1440/2885] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:32:52 2021] DELETE /identity/v3/users/a82d0b9a044e43fba9a353b54b74c680 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:32:53.168669 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:32:53.178550 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1bcdf-b9e8-459c-8e25-b3b187a59bba service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:32:53.236101 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:32:53.236967 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:32:53.237700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:32:53.237700 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] PATH_INFO: `/v3/projects/84ffd96b68cf41c5a9be418ed8c0c61a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:32:53.240113 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ffd96b68cf41c5a9be418ed8c0c61a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:32:53.242019 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:32:53.289696 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ffd96b68cf41c5a9be418ed8c0c61a', 'request_id': 'req-0795aec2-4853-4fae-bd68-95f0cfc6fca4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.295797 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ffd96b68cf41c5a9be418ed8c0c61a', 'request_id': 'req-0795aec2-4853-4fae-bd68-95f0cfc6fca4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.302497 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ffd96b68cf41c5a9be418ed8c0c61a', 'request_id': 'req-0795aec2-4853-4fae-bd68-95f0cfc6fca4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.312317 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] The token cache is being invalidate because project 84ffd96b68cf41c5a9be418ed8c0c61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:32:53.312596 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.313205 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.314732 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1446/2886] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:32:53 2021] DELETE /identity/v3/projects/84ffd96b68cf41c5a9be418ed8c0c61a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:32:53.318867 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:32:53.320318 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:53.332884 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8dcb-4094-481d-ac8b-f3c9b7b3a73a admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:32:53.386569 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:32:53.387453 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:32:53.387743 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:32:53.388016 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] PATH_INFO: `/v3/users/e9aaabb2094e41378c9ba4358869fe83` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:32:53.389217 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9aaabb2094e41378c9ba4358869fe83)` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:32:53.391144 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:32:53.433829 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9aaabb2094e41378c9ba4358869fe83'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.434511 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9aaabb2094e41378c9ba4358869fe83'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.446121 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9aaabb2094e41378c9ba4358869fe83'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.446689 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9aaabb2094e41378c9ba4358869fe83'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.453639 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.notifications [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9aaabb2094e41378c9ba4358869fe83'} {{(pid=79278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.465838 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1441/2887] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Dec 14 03:32:53 2021] DELETE /identity/v3/users/e9aaabb2094e41378c9ba4358869fe83 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:32:53.626716 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:32:53.628190 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:32:53.641057 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795aec2-4853-4fae-bd68-95f0cfc6fca4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:32:53.698665 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56319b0d4c140e5b834fcb4b4fa313b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:32:53.699479 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:32:53.699769 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:32:53.700046 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] PATH_INFO: `/v3/projects/32ff09be74fb44fa9cd1bba92f63f7d6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:32:53.701239 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ff09be74fb44fa9cd1bba92f63f7d6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:32:53.703182 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:32:53.748254 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ff09be74fb44fa9cd1bba92f63f7d6', 'request_id': 'req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.754167 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ff09be74fb44fa9cd1bba92f63f7d6', 'request_id': 'req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.761793 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ff09be74fb44fa9cd1bba92f63f7d6', 'request_id': 'req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.772169 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] The token cache is being invalidate because project 32ff09be74fb44fa9cd1bba92f63f7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 14 03:32:53.772896 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.774078 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0b8aa2ce-3cb1-43d9-b6be-44e613a7e515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 14 03:32:53.775770 dv-cinder-818037-8-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1447/2888] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Dec 14 03:32:53 2021] DELETE /identity/v3/projects/32ff09be74fb44fa9cd1bba92f63f7d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 14 03:34:00.529215 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Authenticating user token {{(pid=79278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 14 03:34:00.530616 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:34:00.596503 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af0db-08ac-4f9a-aed8-d1122d155a84 admin admin] Validating token access rules against request {{(pid=79278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 14 03:34:00.652607 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ae3d39ccc094e7db89711d3f52701f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a78979415294e85b114e4b58915a9fe', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 14 03:34:00.653241 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] REQUEST_METHOD: `GET` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 14 03:34:00.653525 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] SCRIPT_NAME: `/identity` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 14 03:34:00.653802 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 14 03:34:00.655637 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.fernet_utils [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 14 03:34:00.670988 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 14 03:34:00.672609 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd297834-aebe-4b38-9146-0a5dd539c278 service placement] RBAC: Authorization granted {{(pid=79278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 14 03:34:00.683209 dv-cinder-818037-8-iscsi devstack@keystone.service[79278]: [pid: 79278|app: 0|req: 1442/2889] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Dec 14 03:34:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)